-- Logs begin at Fri 2022-05-27 02:22:47 UTC, end at Fri 2022-05-27 03:41:57 UTC. -- May 27 03:14:03.756904 dv-cinder-828806-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:14:03.766319 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:14:03 2022] *** May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: nodename: dv-cinder-828806-4-iscsi May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: machine: x86_64 May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: clock source: unix May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: pcre jit disabled May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: detected number of CPU cores: 4 May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: current working directory: / May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: detected binary path: /usr/bin/uwsgi-core May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: your processes number limit is 47680 May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: your memory page size is 4096 bytes May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: detected max file descriptor number: 2048 May 27 03:14:03.768316 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: lock engine: pthread robust mutexes May 27 03:14:03.769368 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: thunder lock: enabled May 27 03:14:03.769368 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:14:03.769368 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:14:03.812982 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: Python main interpreter initialized at 0x5635ee04c9c0 May 27 03:14:03.812982 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: python threads support enabled May 27 03:14:03.812982 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: your server socket listen backlog is limited to 100 connections May 27 03:14:03.812982 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: your mercy for graceful operations on workers is 90 seconds May 27 03:14:03.813338 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:14:03.813401 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: *** Operational MODE: preforking *** May 27 03:14:03.813671 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: *** uWSGI is running in multiple interpreter mode *** May 27 03:14:03.813671 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: spawned uWSGI master process (pid: 103328) May 27 03:14:03.813857 dv-cinder-828806-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:14:03.814933 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: spawned uWSGI worker 1 (pid: 103329, cores: 1) May 27 03:14:03.815321 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: spawned uWSGI worker 2 (pid: 103330, cores: 1) May 27 03:14:03.815473 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:14:04.963872 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:14:04.997412 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:14:05.678152 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:05.678152 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: from cryptography.utils import int_from_bytes May 27 03:14:05.678660 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:05.678660 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: from cryptography.utils import int_from_bytes May 27 03:14:05.705730 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:05.705730 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: from cryptography.utils import int_from_bytes May 27 03:14:05.706072 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:14:05.706072 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: from cryptography.utils import int_from_bytes May 27 03:14:08.253399 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:14:08.254012 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:14:08.254246 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:14:08.254606 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:14:08.254858 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:14:08.255221 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.255580 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.255904 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.256225 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.256552 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.256860 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.257210 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.257532 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.257857 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.258102 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.258419 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.258737 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-4-iscsi {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.259058 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.259363 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.259677 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.259992 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.260298 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.260617 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.260924 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.261444 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.261887 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.262211 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.262525 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.262865 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.263179 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.263492 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.263813 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.264124 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.264431 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.264743 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.265054 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:14:08.265439 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-4-iscsi {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.265529 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:14:08.265647 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.265778 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.265859 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:14:08.266087 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.266174 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:14:08.266413 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:14:08.266493 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.266808 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.266949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.267156 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.267266 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.267434 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.267527 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.267736 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.267866 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.268044 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.268150 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.268369 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.268459 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.268677 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.268795 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.269014 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.269121 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.269338 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.269431 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.269589 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.269659 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.269946 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.270056 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.270386 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.270667 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-4-iscsi {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.270768 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.271004 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.271261 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.271351 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.271548 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.271653 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.271859 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.271972 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.272181 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.272285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.272493 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.272596 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.272815 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.272915 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.273155 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.273272 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.273401 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.273657 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.273770 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.273967 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.274070 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.274274 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.274379 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.274587 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.274681 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.274910 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.275008 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.275221 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.275308 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.275527 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.275625 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.275835 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.275951 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.276143 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.276294 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.276443 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.276537 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.276759 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.276855 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.277096 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.277192 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-4-iscsi {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.277421 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.277506 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.277729 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.277813 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.278047 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.278131 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.278445 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.278878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.279041 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.279131 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.279349 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.279430 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.279691 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.279784 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.280008 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.280092 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.280309 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.280399 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.280623 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.280706 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.280937 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.281034 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.281268 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.281362 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.281576 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.281675 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.281870 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.281966 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.282184 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.282282 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.282492 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.282576 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.282795 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.282884 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.283046 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.283143 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.283352 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.283442 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.283617 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.283701 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.283922 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.284015 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.284239 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.284330 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.284543 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.284632 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.284848 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.284932 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.285125 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.285211 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.285561 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.285779 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.285873 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.286138 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.286324 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.286445 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.286651 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.286751 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.286966 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.287050 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.287276 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.287369 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.287586 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.287687 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.287893 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.287976 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.288199 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.288282 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.288507 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.288614 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.288813 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.288904 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.289146 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.289244 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.289452 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.289686 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.289787 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.289878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.290063 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.290154 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.290367 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.290464 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.290671 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.290755 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.290993 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.291078 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.291298 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.291393 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.291604 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.291714 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.291983 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.292079 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.292244 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.292336 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.292531 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.292631 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.292848 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.292938 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.293175 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.293279 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.293488 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.293590 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.293787 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.293878 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.294093 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.294182 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.294399 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.294488 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.294701 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.294790 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295001 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295098 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295252 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295342 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295552 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295642 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295871 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.295960 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.296572 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.296647 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.296647 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.296776 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.296776 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.296899 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.297051 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.297146 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.297343 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.297443 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.297645 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.297732 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.297946 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.298032 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.298251 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.298339 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.298556 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.298641 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.298858 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.298943 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.299160 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.299256 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.299466 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.299560 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.299768 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.299871 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.300069 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.300168 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.300385 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.300479 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.300703 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.300807 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.301110 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.301226 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.301499 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.301601 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.301817 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.301949 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.302138 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.302258 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.302456 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.302583 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.302780 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.302875 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.303103 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.303188 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.303433 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.303539 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.303753 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.303856 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.304065 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.304149 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.304381 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.304464 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.304682 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.304777 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.305007 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.305096 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.305329 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.305414 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.305631 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.305725 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.305939 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.306025 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.306254 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.306340 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.306559 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.306654 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.306861 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.306946 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.307162 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.307266 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.307465 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.307552 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.307767 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.307853 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.308069 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.308162 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.308370 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.308457 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.308670 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.308755 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.308982 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.309092 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.309304 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.309416 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.309625 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.309713 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.309937 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.310023 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.310243 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.310330 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.310547 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.310632 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.310855 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.310948 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:14:08.311166 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.311254 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.311498 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.311584 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.311810 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.311956 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.312132 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.312231 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.312442 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.312528 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.312758 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.312856 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.313092 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.313182 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.313403 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.313489 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.313712 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.313806 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.314016 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.314115 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.314322 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.314408 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.314625 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.314719 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.314931 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.315016 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.315231 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.315323 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.315551 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.315644 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.315876 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.315968 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.316182 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.316276 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.316495 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.316581 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.316852 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.317191 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.317434 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.317684 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.317864 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.317998 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.318085 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.318303 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.318397 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.318615 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.318702 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.318925 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.319021 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.319231 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.319317 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.319554 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.319694 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.319866 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.319953 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.320170 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.320256 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.320492 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.320586 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.320797 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.320883 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.321128 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.321217 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.321440 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.321528 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.321749 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.321843 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.322065 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.322160 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.322376 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.322462 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.322688 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.322782 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.323008 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.323103 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.323322 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.323421 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.323629 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.323721 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.323940 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.324039 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.324250 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.324336 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.324565 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.324651 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.324878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.324992 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.325224 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.325321 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.325536 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.325629 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.325838 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.325924 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.326148 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.326234 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.326449 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.326534 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.326753 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.326840 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.327054 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.327145 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.327356 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.327443 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.327657 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.327744 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.327962 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.328048 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.328261 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.328345 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.328563 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.328650 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.328865 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.329019 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.329242 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.329341 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.329520 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.329607 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.329823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.329909 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.330125 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.330225 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.330427 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.330514 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.330733 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.330819 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.331040 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.331135 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.331354 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.331440 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.331666 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.331751 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.331969 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.332063 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.332337 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.332473 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.332871 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.333186 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.333287 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.333499 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.333586 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.333826 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.333968 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.334135 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.334237 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.334442 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.334535 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.334757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.334843 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.335072 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.335168 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.335383 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.335470 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.335695 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.335780 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.336005 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.336100 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.336315 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.336401 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.336631 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.336716 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.336936 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.337054 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.337282 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.337376 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.337610 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.337696 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.337915 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.338005 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.338238 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.338324 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.338558 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.338650 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.338873 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.338967 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.339177 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.339263 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.339483 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.339567 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.339784 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.339877 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.340089 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.340178 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.340392 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.340479 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.340702 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.340796 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.341037 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.341174 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.341343 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.341461 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.341646 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.341749 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.341950 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.342079 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.342253 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.342393 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.342580 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.342713 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.342888 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.343035 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.343193 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.343315 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.343587 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.343671 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.343788 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.343959 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.344128 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.344267 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.344433 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.344577 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.344809 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.344919 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.345132 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.345221 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.345453 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.345540 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.345778 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.345872 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.346089 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.346176 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.346391 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.346478 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.346697 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.346790 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.347009 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.347097 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.347314 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.347399 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.347619 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.347703 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.347995 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.348098 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.348381 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.348694 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.348788 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.349025 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.349133 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.349332 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.349425 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.349644 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.349738 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.349966 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.350059 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.350296 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.350384 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.350594 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.350680 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.350911 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.350999 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.351211 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.351296 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.351514 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.351613 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.351835 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.351922 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.352146 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.352232 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.352456 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.352541 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.352760 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.352856 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.353091 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.353178 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.353404 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.353501 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.353713 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.353800 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.354018 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.354143 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.354332 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.354480 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.354640 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.354734 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.354949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.355034 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.355252 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.355443 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.355557 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.355652 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.355863 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.355949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.356178 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.356276 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.356480 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.356573 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.356786 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.356871 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.357123 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.357211 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.357435 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.357520 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.357744 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.357830 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.358055 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.358221 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.358373 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.358458 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.358680 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.358765 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.358985 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.359072 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.359292 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.359379 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.359593 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.359688 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.359898 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.359992 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.360207 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.360293 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.360521 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.360780 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.360879 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.361141 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.361229 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.361444 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.361534 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.361758 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.361845 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.362066 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.362159 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.362375 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.362460 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.362679 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.362825 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.362987 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.363117 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.363307 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.363438 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.363659 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.363852 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.363984 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.364282 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.364570 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.364700 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.364892 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.365094 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.365231 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.365372 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.365505 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.365637 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.365807 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.365956 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.366119 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.366254 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.366421 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.366556 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.366723 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.366864 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.367014 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.367101 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.367316 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.367448 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.367629 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.367764 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.367932 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.368044 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.368243 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.368373 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.368546 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.368681 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.368856 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.369007 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.369197 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.369332 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.369500 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.369634 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.369803 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.369937 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.370106 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.370247 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.370417 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.370549 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.370726 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.370871 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.371066 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.371217 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.371352 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.371485 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.371640 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.371778 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.371951 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.372098 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.372273 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.372407 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.372582 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.372714 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.372865 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.373056 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.373195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.373328 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.373488 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.373622 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.373834 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.373967 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.374097 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.374226 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.374358 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.374660 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.374758 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.374964 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.375057 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.375274 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.375360 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.375582 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.375677 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.375886 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.375973 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.376195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.376281 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.376496 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.376591 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.376809 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.376896 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.377147 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.377271 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.377452 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.377556 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.377753 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.377840 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.378061 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.378147 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.378365 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.378463 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.378664 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.378748 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.378967 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.379052 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.379313 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.379458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.379627 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.379935 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.380196 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.380289 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.380515 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.380612 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.380818 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.380903 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.381150 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.381239 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.381449 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.381544 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.381751 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.381836 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.382068 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.382162 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.382369 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.382462 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.382666 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.382759 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.382971 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.383059 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.383273 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.383360 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.383574 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.383660 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.383873 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.383961 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.384178 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.384265 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.384480 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.384625 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.384767 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.384930 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.385107 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.385242 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.385376 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.385516 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.385671 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.385812 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.385947 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.386099 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.386257 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.386387 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.386558 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.386696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.386863 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.386999 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.387164 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.387298 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.387466 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.387609 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.387770 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.387905 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.388087 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.388228 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.388394 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.388493 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.388695 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.388783 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.389020 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.389110 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.389324 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.389412 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.389643 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.389729 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.389952 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.390037 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.390249 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.390335 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.390558 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.390644 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.390859 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.390944 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.391174 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.391261 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.391483 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.391570 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.391782 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.391876 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.392083 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.392171 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.392385 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.392470 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.392697 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.392796 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.393023 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.393124 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.393334 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.393427 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.393635 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.393735 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.393938 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.394025 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.394240 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.394325 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.394543 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.394637 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.394874 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.394969 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.395194 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.395363 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.395519 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.395758 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.395854 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.396065 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.396152 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.396388 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.396474 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.396699 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.396798 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.397035 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.397125 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.397341 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.397479 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.397649 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.397734 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.397949 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.398034 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.398250 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.398345 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.398558 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.398643 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.398868 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.398955 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.399179 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.399273 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.399481 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.399567 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.399786 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.399871 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.400087 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.400248 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.400388 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.400474 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.400686 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.400779 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.401019 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.401140 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.401320 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.401429 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.401620 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.401750 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.401921 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.402021 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.402222 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.402316 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.402525 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.402610 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.402842 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.402962 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.403146 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.403233 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.403447 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.403882 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.404093 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.404181 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.404393 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.404486 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.404734 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.404880 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.405062 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.405193 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.405391 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.405525 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.405694 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.405836 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.406006 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.406137 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.406322 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.406456 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.406633 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.406779 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.406942 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.407086 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.407254 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.407385 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.407557 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.407699 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.407867 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.407999 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.408173 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.408305 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.408480 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.408610 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.408792 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.408998 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.409142 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.409276 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.409425 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.409558 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.409696 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.409826 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.409997 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.410129 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.410316 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.410532 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.410750 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.410879 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.411056 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.411188 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.411425 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.411559 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.411735 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.411869 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.412043 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.412186 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.412356 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.412489 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.412665 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.412800 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.412992 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.413157 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.413293 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.413431 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.413598 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.413739 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.413903 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.414048 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.414212 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.414355 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.414522 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.414652 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.414827 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.414965 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.415134 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.415268 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.415435 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.415574 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.415720 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.415852 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.416039 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.416180 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.416346 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.416480 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.416649 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.416784 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.416990 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.417126 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.417281 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.417410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.417590 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.417725 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.417893 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.417980 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.418298 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.418390 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.418602 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.418689 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.418907 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.418994 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.419208 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.419301 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.419508 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.419593 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.419811 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.419906 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.420122 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.420217 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.420422 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.420507 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.420724 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.420830 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.421057 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.421169 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.421366 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.421467 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.421670 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.421757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.421977 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.422072 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.422297 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.422399 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.422598 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.422693 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.422919 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.423006 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.423231 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.423381 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.423517 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.423648 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.423820 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.423951 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.424127 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.424262 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.424446 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.424574 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.424749 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.424873 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.425075 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.425207 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.425380 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.425514 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.425685 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.425814 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.426046 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.426189 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.426402 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.426683 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.427007 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.427107 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.427336 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.427434 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.427645 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.427756 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.427969 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.428072 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.428292 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.428423 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.428671 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.428773 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.428965 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.429072 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.429291 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.429378 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.429593 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.429677 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.429895 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.429989 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.430203 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.430288 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.430504 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.430602 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.430808 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.430903 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.431109 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.431201 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.431415 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.431500 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.431720 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.431804 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.432022 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.432106 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.432322 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.432406 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.432641 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.432734 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.432941 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.433076 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.433356 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.433452 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.433661 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.433748 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.433963 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.434086 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.434299 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.434398 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.434600 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.434730 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.434906 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.434998 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.435208 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.435309 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.435511 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.435630 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.435831 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.435937 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.436134 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.436259 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.436443 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.436586 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.436752 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.436896 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.437084 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.437243 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.437388 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.437560 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.437689 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.437873 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.438011 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.438189 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.438313 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.438504 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.438633 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.438820 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.438946 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.439132 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.439264 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.439447 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.439581 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.439755 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.439897 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.440070 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.440188 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.440381 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.440495 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.440698 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.440795 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.441106 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.441249 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.441411 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.441585 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.441954 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.442125 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.442249 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.442559 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.442651 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.442874 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.442975 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.443186 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.443297 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.443496 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.443589 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.443807 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.443924 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.444139 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.444242 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.444418 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.444568 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.444743 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.444889 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.445106 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.445226 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.445434 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.445554 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.445773 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.445864 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.446090 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.446180 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.446408 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.446494 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.446723 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.446812 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.447036 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.447122 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.447340 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.447425 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.447649 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.447751 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.447946 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.448051 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.448253 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.448362 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.448559 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.448652 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.448887 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.449012 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.449221 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.449321 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.449532 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.449617 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.449843 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.449929 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.450149 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.450246 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.450458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.450544 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.450763 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.450849 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.451075 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.451161 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.451388 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.451475 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.451719 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.451813 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.452036 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.452123 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.452356 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.452445 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.452691 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.452778 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.453021 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.453136 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.453345 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.453447 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.453660 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.453866 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.453965 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.454187 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.454282 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.454524 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.454657 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.454854 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.454944 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.455181 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.455267 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.455490 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.455597 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.455798 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.455890 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.456113 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.456200 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.456421 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.456507 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.456726 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.456813 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.457060 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.457316 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.457407 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.457686 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.458095 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.458193 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.458414 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.458501 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.458725 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.458823 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.459036 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.459122 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.459346 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.459433 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.459658 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.459877 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.459964 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.460229 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.460316 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.460545 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.460640 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.460868 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.460976 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.461216 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.461303 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.461536 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.461641 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.461843 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.461930 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.462167 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.462257 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.462473 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.462569 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.462777 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.462864 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.463090 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.463176 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.463401 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.463495 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.463706 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.463817 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.464012 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.464111 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.464322 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.464417 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.464629 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.464738 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.464932 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.465039 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.465263 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.465357 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.465565 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.465652 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.465872 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.465957 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.466182 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.466266 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.466483 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.466568 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.466785 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.466878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.467093 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.467177 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.467395 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.467478 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.467696 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.467804 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.467998 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.468090 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.468303 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.468394 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.468607 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.468701 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.468908 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.469101 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.469244 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.469330 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.469553 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.469648 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.469924 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.470075 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.470227 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.470366 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.470534 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.470700 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.470886 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.471026 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.471210 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.471348 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.471526 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.471662 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.471831 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.471975 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.472146 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.472300 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.472454 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.472610 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.472779 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.473116 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.473237 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.473557 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.473702 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.473905 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.474040 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.474221 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.474349 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.474580 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.474750 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.474913 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.475083 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.475237 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.475401 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.475572 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.475732 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.475899 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.476066 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.476373 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.476522 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.476682 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.476813 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.477010 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.477152 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.477341 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.477467 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.477653 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.477788 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.477966 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.478101 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.478275 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.478413 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.478586 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.478714 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.478895 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.479026 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.479203 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.479343 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.479514 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.479642 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.479821 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.479959 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.480131 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.480265 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.480438 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.480570 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.480745 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.480871 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.481079 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.481208 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.481392 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.481520 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.481710 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.481838 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.482049 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.482181 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.482362 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.482504 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.482679 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.482815 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.482987 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.483116 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.483300 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.483429 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.483609 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.483740 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.483915 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.484043 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.484223 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.484348 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.484527 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.484742 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.484885 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.485047 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.485174 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.485303 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.485436 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.485580 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.485861 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.485990 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.486120 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.486258 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.486399 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.486539 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.486668 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.486804 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.486942 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.487073 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.487282 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.487421 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.487613 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.487740 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.487926 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.488075 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.488237 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.488388 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.488578 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.488762 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.488896 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.489155 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.489362 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.489495 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.489634 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.489825 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.489953 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.490159 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.490296 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.490483 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.490611 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.490790 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.491023 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.491163 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.491365 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.491492 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.491673 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.491809 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.492005 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.492140 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.492321 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.492448 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.492626 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.492762 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.492931 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.493099 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.493266 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.493398 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.493573 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.493700 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.493878 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.494008 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.494183 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.494311 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.494487 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.494614 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.494797 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.494934 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.495098 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.495235 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.495404 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.495541 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.495710 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.495842 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.496012 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.496142 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.496317 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.496459 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.496622 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.496753 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.496930 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.497103 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.497259 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.497397 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.497564 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.497691 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.497869 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.497995 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.498177 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.498315 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.498477 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.498617 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.498807 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.498934 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.499124 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.499263 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.499440 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.499568 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.499752 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.499878 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.500062 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.500189 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.500373 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.500500 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.500681 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.500806 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.501020 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.501150 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.501346 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.501471 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.501660 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.501785 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.501966 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.502096 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.502302 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.502444 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.502614 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.502746 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.502926 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.503065 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.503239 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.503376 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.503597 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.503744 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.503882 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.504012 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.504229 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.504418 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.504607 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.504776 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505026 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505155 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505290 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505429 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505560 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505698 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505830 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.505962 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.506100 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.506230 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.506379 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.506534 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.506689 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.506846 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.507021 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.507148 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.507334 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.507461 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.507644 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.507771 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.507962 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.508090 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.508278 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.508397 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.508591 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.508729 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.508901 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.509064 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.509258 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.509392 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.509562 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.509688 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.509871 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.510010 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.510178 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.510323 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.510485 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.510617 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.510798 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.510937 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.511106 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.511233 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.511412 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.511538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.511717 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.511869 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.512009 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.512163 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.512315 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.512446 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.512621 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.512752 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.512934 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.513119 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.513251 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:14:08.513381 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.513594 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.513853 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.514163 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.514469 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.514802 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.515138 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.515458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.515782 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.516096 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.516421 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.516732 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.517088 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.517417 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.517736 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.518048 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.518383 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.518698 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.519013 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.519327 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.519642 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.519960 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.520344 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.520853 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.521214 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.521526 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.521857 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.522181 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.522508 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.522829 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.523146 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.523486 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.523803 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.524117 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.524436 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.524751 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.525093 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.525418 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.525740 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.526071 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.526403 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.526718 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.527051 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.527382 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.527735 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.528052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.528399 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.529094 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.529417 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.529734 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.530047 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:14:08.530294 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:14:08.570950 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO dbcounter [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Registered counter for database nova_api May 27 03:14:08.588204 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Registered counter for database nova_api May 27 03:14:08.592118 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_db.sqlalchemy.engines [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.599208 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writer thread running {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:08.608331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.615423 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:08.657454 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.context [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3177609-63d6-4369-942a-1c4f9ce92a70(cell1) {{(pid=103329) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:14:08.661838 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_concurrency.lockutils [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:14:08.663437 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_concurrency.lockutils [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:14:08.664222 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_concurrency.lockutils [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:14:08.666225 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_concurrency.lockutils [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:14:08.668233 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO dbcounter [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Registered counter for database nova_cell0 May 27 03:14:08.672263 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO dbcounter [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Registered counter for database nova_cell1 May 27 03:14:08.673504 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.context [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3177609-63d6-4369-942a-1c4f9ce92a70(cell1) {{(pid=103330) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:14:08.677825 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:14:08.679426 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:14:08.679921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_db.sqlalchemy.engines [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.680243 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:14:08.681649 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_db.sqlalchemy.engines [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.682295 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:14:08.684349 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Registered counter for database nova_cell0 May 27 03:14:08.687970 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writer thread running {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:08.688359 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Registered counter for database nova_cell1 May 27 03:14:08.689243 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writer thread running {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:08.696936 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.699200 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.704273 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:08.706760 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:08.835874 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO dbcounter [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Registered counter for database nova_cell0 May 27 03:14:08.844998 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG oslo_db.sqlalchemy.engines [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.850235 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writer thread running {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:08.854840 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO dbcounter [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Registered counter for database nova_cell0 May 27 03:14:08.864191 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_db.sqlalchemy.engines [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:14:08.869676 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writer thread running {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:14:09.183233 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: WARNING keystonemiddleware.auth_token [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:14:09.184080 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:14:09.190525 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: WARNING keystonemiddleware.auth_token [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:14:09.191299 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:14:09.532486 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: WARNING keystonemiddleware.auth_token [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:14:09.534814 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:14:09.538450 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: WARNING keystonemiddleware.auth_token [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:14:09.540907 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: WARNING keystonemiddleware.auth_token [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:14:09.543699 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635ee04c9c0 pid: 103329 (default app) May 27 03:14:09.545796 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:14:09.546164 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635ee04c9c0 pid: 103330 (default app) May 27 03:14:09.546974 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-12c20fb4-6357-45c7-84a8-160d0881aab9 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 May 27 03:14:09.547357 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Fri May 27 03:14:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:28.520031 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:28.521292 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 May 27 03:15:28.525291 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:28.533478 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writing DB stats nova_api:SELECT=3 {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:28.534641 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writing DB stats nova_cell0:SELECT=3 {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:28.535761 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writing DB stats nova_cell1:SELECT=3 {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:28.536609 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:28.986068 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-b3839883-6b8b-4d88-b1fa-e7dbf88f9eea admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:29.018935 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-b3839883-6b8b-4d88-b1fa-e7dbf88f9eea admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490950 May 27 03:15:29.019449 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 2/3] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 03:15:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:31.286322 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:31.287337 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-308edc94-7294-439a-8fa4-f8694a56fbdc None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 27 03:15:31.287739 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 2/4] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:31.347142 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-ee5e2ae9-8490-4721-8eb9-71b81543a454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:31.365844 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:15:31.365844 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: warnings.warn(msg) May 27 03:15:31.396075 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-ee5e2ae9-8490-4721-8eb9-71b81543a454 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102230 May 27 03:15:31.398476 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 3/5] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:15:31.638699 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-367b0e4c-e7cc-4c20-95dc-e2ddb1c89ac0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:31.641295 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:15:31.641295 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 27 03:15:31.657382 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:31.658823 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell1:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:31.660051 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:31.660990 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=3 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:15:31.712033 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-367b0e4c-e7cc-4c20-95dc-e2ddb1c89ac0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302989 May 27 03:15:31.712807 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 3/6] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 03:15:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:34.010474 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-ee5e2ae9-8490-4721-8eb9-71b81543a454 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:34.011624 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-ee5e2ae9-8490-4721-8eb9-71b81543a454 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 27 03:15:34.012144 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 4/7] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:34.137824 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-95639fe4-20d2-4824-b5d2-1b6afbf82eba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "ram": 512, "name": "ds512M"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:34.155942 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:15:34.155942 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 27 03:15:34.176795 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-95639fe4-20d2-4824-b5d2-1b6afbf82eba admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158280 May 27 03:15:34.177499 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 4/8] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:15:34.189586 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-5505b94b-48a9-4ee6-a59c-c9a91e4bdc7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:34.191140 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:15:34.191140 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: warnings.warn(msg) May 27 03:15:34.225785 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-5505b94b-48a9-4ee6-a59c-c9a91e4bdc7f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039997 May 27 03:15:34.226377 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 5/9] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 03:15:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:36.471693 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-95639fe4-20d2-4824-b5d2-1b6afbf82eba admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:36.472722 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-95639fe4-20d2-4824-b5d2-1b6afbf82eba admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 27 03:15:36.473204 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:36.542254 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-5d6fbc0f-5f47-436e-a1ef-71441520ef67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "swap": 0}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:36.564667 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-5d6fbc0f-5f47-436e-a1ef-71441520ef67 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085241 May 27 03:15:36.569099 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 6/11] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:15:36.577590 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e83d256f-ed10-4620-91c5-4e52d35493c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:36.602694 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e83d256f-ed10-4620-91c5-4e52d35493c1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029369 May 27 03:15:36.603460 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 6/12] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 03:15:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:38.872564 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-5d6fbc0f-5f47-436e-a1ef-71441520ef67 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:38.873642 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-5d6fbc0f-5f47-436e-a1ef-71441520ef67 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 May 27 03:15:38.874072 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 7/13] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:38.937514 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-825467e9-c7b6-4bc9-afe7-a92d98187b15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "swap": 0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:38.960466 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-825467e9-c7b6-4bc9-afe7-a92d98187b15 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079228 May 27 03:15:38.961268 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 7/14] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:15:38.973665 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-91cb6c07-7ba5-4962-b41a-1932eeda8081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:38.999925 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-91cb6c07-7ba5-4962-b41a-1932eeda8081 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030011 May 27 03:15:39.000624 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 8/15] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 03:15:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:41.257521 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-825467e9-c7b6-4bc9-afe7-a92d98187b15 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:41.258587 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-825467e9-c7b6-4bc9-afe7-a92d98187b15 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 May 27 03:15:41.259167 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 8/16] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:41.327313 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-11d7a90b-ec47-4146-b742-7aa67ba1526c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "id": "d4"}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:41.347635 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-11d7a90b-ec47-4146-b742-7aa67ba1526c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082403 May 27 03:15:41.348857 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 9/17] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:15:41.361117 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-6052570b-0e99-4c7d-b09a-42a02553e28b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:41.385373 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-6052570b-0e99-4c7d-b09a-42a02553e28b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028492 May 27 03:15:41.386337 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 9/18] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 03:15:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:43.674406 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-11d7a90b-ec47-4146-b742-7aa67ba1526c admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:43.675419 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-11d7a90b-ec47-4146-b742-7aa67ba1526c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 27 03:15:43.675804 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 10/19] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:43.743789 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-bc93dcf6-ece8-48e5-b4d0-de0d94b2c177 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:43.769075 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-bc93dcf6-ece8-48e5-b4d0-de0d94b2c177 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086802 May 27 03:15:43.775228 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 10/20] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 03:15:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:15:46.102877 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-11d7a90b-ec47-4146-b742-7aa67ba1526c admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:46.104062 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-11d7a90b-ec47-4146-b742-7aa67ba1526c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 May 27 03:15:46.104519 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 11/21] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:46.177354 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a3d80e53-c440-4ca6-abf8-dd6dde3f7276 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "swap": 0}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:46.199871 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-a3d80e53-c440-4ca6-abf8-dd6dde3f7276 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088253 May 27 03:15:46.200584 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 11/22] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:15:46.213150 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-db35c926-138b-4a53-940d-459c411ce3f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:46.240548 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-db35c926-138b-4a53-940d-459c411ce3f1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031314 May 27 03:15:46.241140 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 12/23] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 03:15:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:48.856449 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-a3d80e53-c440-4ca6-abf8-dd6dde3f7276 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:48.857777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-a3d80e53-c440-4ca6-abf8-dd6dde3f7276 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 May 27 03:15:48.858297 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:48.923895 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-4d627905-4358-4089-b065-2f06f087090d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:48.943059 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-4d627905-4358-4089-b065-2f06f087090d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077513 May 27 03:15:48.943609 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 13/25] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:15:48.957597 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-09b212bc-6333-4c26-94b0-ee380fb72d24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:48.983101 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-09b212bc-6333-4c26-94b0-ee380fb72d24 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028973 May 27 03:15:48.983653 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 13/26] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 03:15:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:51.541811 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-4d627905-4358-4089-b065-2f06f087090d admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:51.542835 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-4d627905-4358-4089-b065-2f06f087090d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 May 27 03:15:51.543238 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 14/27] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:51.601672 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-961cecdb-1048-47c9-9533-9871e4f52a2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "id": "3", "vcpus": 2}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:51.620995 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-961cecdb-1048-47c9-9533-9871e4f52a2a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071948 May 27 03:15:51.621562 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 14/28] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:15:51.633773 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-de11cd86-d425-4f17-9e03-cfcbdfaed232 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:51.660066 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-de11cd86-d425-4f17-9e03-cfcbdfaed232 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030134 May 27 03:15:51.660635 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 15/29] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 03:15:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:53.899494 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-961cecdb-1048-47c9-9533-9871e4f52a2a admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:53.900798 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-961cecdb-1048-47c9-9533-9871e4f52a2a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 27 03:15:53.901644 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 15/30] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:53.958920 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-46754503-aa9c-4a40-92d9-476545d4874d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "vcpus": 4}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:53.978854 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-46754503-aa9c-4a40-92d9-476545d4874d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070585 May 27 03:15:53.979407 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 16/31] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:15:53.991816 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c695bf60-f10f-45c9-82c1-274c3bcacc15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:54.018619 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c695bf60-f10f-45c9-82c1-274c3bcacc15 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030398 May 27 03:15:54.019213 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 16/32] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 03:15:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:15:56.377170 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-46754503-aa9c-4a40-92d9-476545d4874d admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:15:56.378917 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-46754503-aa9c-4a40-92d9-476545d4874d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 May 27 03:15:56.381135 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 17/33] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:15:56 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:15:56.447097 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-8195efbc-5c2d-480a-95f6-27f40145147a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:56.468526 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-8195efbc-5c2d-480a-95f6-27f40145147a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082895 May 27 03:15:56.473166 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 17/34] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 03:15:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:15:56.481242 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-37425f6d-b58f-4fea-9ee2-2e8c7e34b290 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:15:56.507322 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-37425f6d-b58f-4fea-9ee2-2e8c7e34b290 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029959 May 27 03:15:56.507920 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 18/35] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 03:15:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:16:20.908564 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-8195efbc-5c2d-480a-95f6-27f40145147a admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:20.909640 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-8195efbc-5c2d-480a-95f6-27f40145147a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 27 03:16:20.910066 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 18/36] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:16:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:20.924455 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:20.980153 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-50686a25-34e0-4ffa-b91d-276f48833b51 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:20.997908 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-50686a25-34e0-4ffa-b91d-276f48833b51 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.081103 May 27 03:16:20.998457 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 19/37] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 03:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:16:21.999736 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-8195efbc-5c2d-480a-95f6-27f40145147a admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:22.000811 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-8195efbc-5c2d-480a-95f6-27f40145147a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 May 27 03:16:22.001243 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 19/38] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:22.219552 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-492d84ad-fe1c-4b6d-8d7d-bec6d1b5b44a admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:22.225662 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.wsgi [None req-492d84ad-fe1c-4b6d-8d7d-bec6d1b5b44a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-492d84ad-fe1c-4b6d-8d7d-bec6d1b5b44a admin admin] Request method failure captured: May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Accept: application/json May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Accept-Encoding: gzip, deflate May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Connection: keep-alive May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Content-Length: 0 May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Host: 10.222.0.50 May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Openstack-Api-Version: compute 2.90 May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Openstack-System-Scope: None May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: User-Agent: python-novaclient May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Auth-Token: gAAAAABikEKFPgD0U0mdq0F7W49NK4Dg-tEB9fgCAk7cjrdSOVG8i1m_-3N8HbBOYhP_QlWSbQPuhH5vjWI2-iM9SxArrswbafhDbe29CWSMdtcrAfOdc9XdC6w-OTYGYupbGSRJ64jpQZs-8dbPlDVmyrCP9BwHkA9nW6a1Dof445thfkwdV4Y May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Domain-Id: None May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Domain-Name: None May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Identity-Status: Confirmed May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Is-Admin-Project: True May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Domain-Id: default May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Domain-Name: Default May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Name: admin May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Role: member,admin,reader May 27 03:16:22.228921 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Roles: member,admin,reader May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_73644351894d46fdb8889fca96b4c614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/73644351894d46fdb8889fca96b4c614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant: admin May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant-Name: admin May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User: admin May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Domain-Id: default May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Domain-Name: Default May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Id: 4a96d7acf93e46c7ac5700560db36dbe May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Name: admin May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: method: > May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: exception: Flavor 42 could not be found. May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: action_args: {'id': '42'} May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:16:22.230410 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:22.231490 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:22.233133 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-492d84ad-fe1c-4b6d-8d7d-bec6d1b5b44a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:16:22.235013 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-492d84ad-fe1c-4b6d-8d7d-bec6d1b5b44a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.072451 May 27 03:16:22.235013 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 20/39] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 03:16:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:16:22.240492 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-0fc83098-3b85-4223-af11-8db48f5bc581 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:22.243413 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:22.264009 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-0fc83098-3b85-4223-af11-8db48f5bc581 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027202 May 27 03:16:22.264605 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 20/40] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 03:16:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:16:22.300144 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-3090a23a-cbd4-447d-a273-0e973bb4587a admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:22.322021 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-3090a23a-cbd4-447d-a273-0e973bb4587a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026183 May 27 03:16:22.322559 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 21/41] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 03:16:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:16:22.335476 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e47f522c-615b-4e42-80b5-5a4b41fe9d58 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:22.345292 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-e47f522c-615b-4e42-80b5-5a4b41fe9d58 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e47f522c-615b-4e42-80b5-5a4b41fe9d58 admin admin] Request method failure captured: May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Accept: application/json May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Host: 10.222.0.50 May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABikEKFPgD0U0mdq0F7W49NK4Dg-tEB9fgCAk7cjrdSOVG8i1m_-3N8HbBOYhP_QlWSbQPuhH5vjWI2-iM9SxArrswbafhDbe29CWSMdtcrAfOdc9XdC6w-OTYGYupbGSRJ64jpQZs-8dbPlDVmyrCP9BwHkA9nW6a1Dof445thfkwdV4Y May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Role: member,admin,reader May 27 03:16:22.350458 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Roles: member,admin,reader May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_73644351894d46fdb8889fca96b4c614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/73644351894d46fdb8889fca96b4c614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User: admin May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Id: 4a96d7acf93e46c7ac5700560db36dbe May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: method: > May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: exception: Flavor 42 could not be found. May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: action_args: {'id': '42'} May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:16:22.351878 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:22.352757 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:22.354052 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-e47f522c-615b-4e42-80b5-5a4b41fe9d58 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:16:22.355278 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-e47f522c-615b-4e42-80b5-5a4b41fe9d58 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.022194 May 27 03:16:22.355278 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 21/42] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 03:16:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:16:23.238241 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-3090a23a-cbd4-447d-a273-0e973bb4587a admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:23.239247 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-3090a23a-cbd4-447d-a273-0e973bb4587a admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 27 03:16:23.239643 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 22/43] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:23.442619 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c685508e-abaa-4d03-97cf-c3be49cf29c4 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:23.448687 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-c685508e-abaa-4d03-97cf-c3be49cf29c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c685508e-abaa-4d03-97cf-c3be49cf29c4 admin admin] Request method failure captured: May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Accept: application/json May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Host: 10.222.0.50 May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABikEKHoVrWSmOs3oWa5rMbBILJ3s1fz-rkEDEr2rYkRRMsZ_6xLhO4BcaotQr2MbRl_iZapo2gadO3tJ2VywNb2dy-rJkREivEn9eCxfc9CgPh0iorFl5rY06dIZvekrvp_3xz7CXipb_Y0nBDkJJn-_QMv-fYKO2xRa32JrKD_UkjtA8 May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Role: member,admin,reader May 27 03:16:23.450190 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Roles: member,admin,reader May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_73644351894d46fdb8889fca96b4c614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/73644351894d46fdb8889fca96b4c614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User: admin May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Id: 4a96d7acf93e46c7ac5700560db36dbe May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: method: > May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: exception: Flavor 84 could not be found. May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: action_args: {'id': '84'} May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:16:23.451696 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:23.452545 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:23.453818 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c685508e-abaa-4d03-97cf-c3be49cf29c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:16:23.454843 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c685508e-abaa-4d03-97cf-c3be49cf29c4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072883 May 27 03:16:23.454843 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 22/44] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 03:16:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:16:23.461987 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-c3dec4b5-db3d-4374-ab95-21b1e7f9a97d admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:23.477647 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-c3dec4b5-db3d-4374-ab95-21b1e7f9a97d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019348 May 27 03:16:23.478172 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 03:16:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:16:23.488372 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c059fff6-ee35-4c8b-871e-dea0f86df7dd admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:23.503214 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c059fff6-ee35-4c8b-871e-dea0f86df7dd admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018440 May 27 03:16:23.503715 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 03:16:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:16:23.515573 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-2fe945ef-64be-458a-8eaf-815c6d64c64a admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:23.521311 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.wsgi [None req-2fe945ef-64be-458a-8eaf-815c6d64c64a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-2fe945ef-64be-458a-8eaf-815c6d64c64a admin admin] Request method failure captured: May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Accept: application/json May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Accept-Encoding: gzip, deflate May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Connection: keep-alive May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Content-Length: 0 May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Host: 10.222.0.50 May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Openstack-Api-Version: compute 2.90 May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Openstack-System-Scope: None May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: User-Agent: python-novaclient May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Auth-Token: gAAAAABikEKHoVrWSmOs3oWa5rMbBILJ3s1fz-rkEDEr2rYkRRMsZ_6xLhO4BcaotQr2MbRl_iZapo2gadO3tJ2VywNb2dy-rJkREivEn9eCxfc9CgPh0iorFl5rY06dIZvekrvp_3xz7CXipb_Y0nBDkJJn-_QMv-fYKO2xRa32JrKD_UkjtA8 May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Domain-Id: None May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Domain-Name: None May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Identity-Status: Confirmed May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Is-Admin-Project: True May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Domain-Id: default May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Domain-Name: Default May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Name: admin May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Role: member,admin,reader May 27 03:16:23.522823 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Roles: member,admin,reader May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_73644351894d46fdb8889fca96b4c614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/73644351894d46fdb8889fca96b4c614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant: admin May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant-Name: admin May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User: admin May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Domain-Id: default May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Domain-Name: Default May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Id: 4a96d7acf93e46c7ac5700560db36dbe May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Name: admin May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: method: > May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: exception: Flavor 84 could not be found. May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: action_args: {'id': '84'} May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:16:23.524209 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:23.525285 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:23.526949 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-2fe945ef-64be-458a-8eaf-815c6d64c64a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:16:23.528187 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-2fe945ef-64be-458a-8eaf-815c6d64c64a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014263 May 27 03:16:23.528187 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 24/47] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 03:16:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:16:24.456567 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-c059fff6-ee35-4c8b-871e-dea0f86df7dd admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:24.457617 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-c059fff6-ee35-4c8b-871e-dea0f86df7dd admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 27 03:16:24.458011 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 24/48] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:24.653383 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-36c0adac-54e2-4add-bb8c-277699ee9214 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:24.659604 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.wsgi [None req-36c0adac-54e2-4add-bb8c-277699ee9214 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-36c0adac-54e2-4add-bb8c-277699ee9214 admin admin] Request method failure captured: May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Accept: application/json May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Accept-Encoding: gzip, deflate May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Connection: keep-alive May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Content-Length: 0 May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Host: 10.222.0.50 May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Openstack-Api-Version: compute 2.90 May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Openstack-System-Scope: None May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: User-Agent: python-novaclient May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Auth-Token: gAAAAABikEKItnmAdakzobqZb3wBourCb5RryZ9rC6QlfB9XqzmTA4FtKMkt3T4YFrw5QtF38tU00uWj40OoilINda9o9UPc7TU1NboQZWx2-Ft1cCJREjYhnx7ZXikUvomgcgjAKA-JfIA7273CfHtUnYfYwgX2u2eh9-oZZQeS7v1LoP9-jXo May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Domain-Id: None May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Domain-Name: None May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Identity-Status: Confirmed May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Is-Admin-Project: True May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Domain-Id: default May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Domain-Name: Default May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Project-Name: admin May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Role: member,admin,reader May 27 03:16:24.661195 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Roles: member,admin,reader May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_73644351894d46fdb8889fca96b4c614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/73644351894d46fdb8889fca96b4c614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant: admin May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-Tenant-Name: admin May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User: admin May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Domain-Id: default May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Domain-Name: Default May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Id: 4a96d7acf93e46c7ac5700560db36dbe May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: X-User-Name: admin May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: method: > May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: exception: Flavor 451 could not be found. May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: action_args: {'id': '451'} May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:16:24.662678 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:24.663538 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: ERROR nova.api.openstack.wsgi May 27 03:16:24.664717 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-36c0adac-54e2-4add-bb8c-277699ee9214 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:16:24.665783 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-36c0adac-54e2-4add-bb8c-277699ee9214 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069640 May 27 03:16:24.665783 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 25/49] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 03:16:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:16:24.673208 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-efd6d88c-618c-47dc-8003-30a74409b688 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:24.687349 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-efd6d88c-618c-47dc-8003-30a74409b688 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017764 May 27 03:16:24.687913 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 25/50] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 03:16:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:16:24.697277 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:24.711246 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017514 May 27 03:16:24.711761 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 26/51] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 03:16:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:16:24.723649 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-3de78493-b9d0-46c5-8be7-0329c442ca39 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:24.731749 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.wsgi [None req-3de78493-b9d0-46c5-8be7-0329c442ca39 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-3de78493-b9d0-46c5-8be7-0329c442ca39 admin admin] Request method failure captured: May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Accept: application/json May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Accept-Encoding: gzip, deflate May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Connection: keep-alive May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Content-Length: 0 May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Host: 10.222.0.50 May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Openstack-Api-Version: compute 2.90 May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Openstack-System-Scope: None May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: User-Agent: python-novaclient May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Auth-Token: gAAAAABikEKItnmAdakzobqZb3wBourCb5RryZ9rC6QlfB9XqzmTA4FtKMkt3T4YFrw5QtF38tU00uWj40OoilINda9o9UPc7TU1NboQZWx2-Ft1cCJREjYhnx7ZXikUvomgcgjAKA-JfIA7273CfHtUnYfYwgX2u2eh9-oZZQeS7v1LoP9-jXo May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Domain-Id: None May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Domain-Name: None May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Identity-Status: Confirmed May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Is-Admin-Project: True May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Openstack-Nova-Api-Version: 2.90 May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Domain-Id: default May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Domain-Name: Default May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Project-Name: admin May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Role: member,admin,reader May 27 03:16:24.734331 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Roles: member,admin,reader May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_73644351894d46fdb8889fca96b4c614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/73644351894d46fdb8889fca96b4c614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/73644351894d46fdb8889fca96b4c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant: admin May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant-Id: 73644351894d46fdb8889fca96b4c614 May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-Tenant-Name: admin May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User: admin May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Domain-Id: default May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Domain-Name: Default May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Id: 4a96d7acf93e46c7ac5700560db36dbe May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: X-User-Name: admin May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: method: > May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: exception: Flavor 451 could not be found. May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: action_args: {'id': '451'} May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:16:24.735833 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:24.736656 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: ERROR nova.api.openstack.wsgi May 27 03:16:24.737777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-3de78493-b9d0-46c5-8be7-0329c442ca39 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:16:24.738985 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-3de78493-b9d0-46c5-8be7-0329c442ca39 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017954 May 27 03:16:24.738985 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 26/52] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 03:16:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:16:25.611199 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:25.612212 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 27 03:16:25.612600 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 27/53] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:25.813477 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-32627dff-4e43-4445-8542-290107d8101d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:25.840502 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-32627dff-4e43-4445-8542-290107d8101d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.091829 May 27 03:16:25.840981 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 27/54] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 03:16:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:26.713100 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:26.714101 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 27 03:16:26.714494 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:26.927566 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-9f36ef7b-8f12-4959-9115-82056e1a86c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:26.950738 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-9f36ef7b-8f12-4959-9115-82056e1a86c4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.096296 May 27 03:16:26.951312 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 28/56] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 03:16:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:27.820720 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:27.821772 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 May 27 03:16:27.822166 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 29/57] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:28.019146 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-cb69373c-1662-4c1b-b3e5-113a7279a8e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:28.039290 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-cb69373c-1662-4c1b-b3e5-113a7279a8e7 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076797 May 27 03:16:28.039834 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 29/58] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 03:16:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:28.925728 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:28.927009 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 May 27 03:16:28.927562 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 30/59] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:29.121252 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-6ac6e0f2-3e6f-4077-a194-608b8fdab465 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:16:29.148640 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-6ac6e0f2-3e6f-4077-a194-608b8fdab465 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084288 May 27 03:16:29.149553 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 30/60] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 03:16:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:16:30.020392 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:30.021440 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 27 03:16:30.021824 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 31/61] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:16:30.220929 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-fa4c6c21-a02d-4a38-bb0b-df88f266fe0b admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:16:30.240088 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-fa4c6c21-a02d-4a38-bb0b-df88f266fe0b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079145 May 27 03:16:30.240621 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 31/62] 10.222.0.50 () {60 vars in 1202 bytes} [Fri May 27 03:16:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:17:32.722332 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:32.723649 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-6af8731a-c063-46fe-9d05-bc93345f1241 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 May 27 03:17:32.724270 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 32/63] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 03:17:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:17:32.733614 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:32.800756 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-3b04c701-816b-44a2-9c8e-4e2cb50354b5 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:32.820068 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-3b04c701-816b-44a2-9c8e-4e2cb50354b5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.088866 May 27 03:17:32.820602 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 32/64] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 03:17:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:17:32.843702 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG dbcounter [-] [103329] Writing DB stats nova_api:SELECT=14 {{(pid=103329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:32.847760 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-e9d85d04-378e-4178-a58a-cec96bb184f8 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:32.858790 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-e9d85d04-378e-4178-a58a-cec96bb184f8 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016534 May 27 03:17:32.859309 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 33/65] 10.222.0.50 () {60 vars in 1282 bytes} [Fri May 27 03:17:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:17:32.873381 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-6a8862a2-979d-402f-b4a3-2ee73152353c admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:32.885163 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-6a8862a2-979d-402f-b4a3-2ee73152353c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017231 May 27 03:17:32.885870 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 33/66] 10.222.0.50 () {60 vars in 1285 bytes} [Fri May 27 03:17:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:17:32.897985 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:32.906208 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011832 May 27 03:17:32.906727 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 34/67] 10.222.0.50 () {60 vars in 1285 bytes} [Fri May 27 03:17:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:17:32.922481 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-592b6fea-2a01-400b-ba69-bba4ddaa6e47 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:17:32.930631 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-592b6fea-2a01-400b-ba69-bba4ddaa6e47 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012256 May 27 03:17:32.931165 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 34/68] 10.222.0.50 () {60 vars in 1282 bytes} [Fri May 27 03:17:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:21:08.101487 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:08.102498 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 27 03:21:08.102886 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 35/69] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:21:08.259653 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=6 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:08.398453 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-42924bac-63ee-4efd-b5e1-a2b96b145479 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:08.399675 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:21:08.399675 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 27 03:21:08.400857 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-42924bac-63ee-4efd-b5e1-a2b96b145479 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:08.401316 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-42924bac-63ee-4efd-b5e1-a2b96b145479 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:08.402075 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-42924bac-63ee-4efd-b5e1-a2b96b145479 admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:08.402488 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-42924bac-63ee-4efd-b5e1-a2b96b145479 admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:08.437454 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-42924bac-63ee-4efd-b5e1-a2b96b145479 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179224 May 27 03:21:08.438060 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 35/70] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 03:21:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:21:09.323998 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:09.325037 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 27 03:21:09.325488 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 36/71] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:21:09.523610 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-32d08bdd-23ac-4ddf-a6f5-23915468685c admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:09.524788 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:21:09.524788 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 27 03:21:09.526125 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-32d08bdd-23ac-4ddf-a6f5-23915468685c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:09.526554 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-32d08bdd-23ac-4ddf-a6f5-23915468685c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:09.527322 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-32d08bdd-23ac-4ddf-a6f5-23915468685c admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:09.527777 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-32d08bdd-23ac-4ddf-a6f5-23915468685c admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:09.548516 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-32d08bdd-23ac-4ddf-a6f5-23915468685c admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083030 May 27 03:21:09.549033 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 36/72] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 03:21:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:21:20.863191 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:20.864213 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 27 03:21:20.864585 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 37/73] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:21:21.009486 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell0:SELECT=4 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:21.010363 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_cell1:SELECT=4 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:21.011099 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG dbcounter [-] [103330] Writing DB stats nova_api:SELECT=8 {{(pid=103330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:21.065707 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-eb4904f5-463e-4a27-b133-b2f198244289 admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:21.067120 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:21:21.067120 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 27 03:21:21.068443 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-eb4904f5-463e-4a27-b133-b2f198244289 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:21.068969 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-eb4904f5-463e-4a27-b133-b2f198244289 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:21.069828 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-eb4904f5-463e-4a27-b133-b2f198244289 admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:21.070411 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-eb4904f5-463e-4a27-b133-b2f198244289 admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:21.097954 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-eb4904f5-463e-4a27-b133-b2f198244289 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095570 May 27 03:21:21.098434 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 37/74] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 03:21:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:21:22.021258 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: DEBUG nova.api.openstack.wsgi [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] Calling method '>' {{(pid=103329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:22.022270 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: INFO nova.api.openstack.requestlog [None req-e7a00af8-87b8-42bf-aeec-27f800487b32 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 27 03:21:22.022669 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: [pid: 103329|app: 0|req: 38/75] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 03:21:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:21:22.220592 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG nova.api.openstack.wsgi [None req-94453dc5-c760-4200-8dc9-0b1a7b094add admin admin] Calling method '>' {{(pid=103330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:21:22.222613 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:21:22.222613 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: warnings.warn(msg) May 27 03:21:22.224502 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-94453dc5-c760-4200-8dc9-0b1a7b094add admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:22.225289 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-94453dc5-c760-4200-8dc9-0b1a7b094add admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:22.226567 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-94453dc5-c760-4200-8dc9-0b1a7b094add admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:21:22.227270 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: DEBUG oslo_concurrency.lockutils [None req-94453dc5-c760-4200-8dc9-0b1a7b094add admin admin] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:21:22.251765 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: INFO nova.api.openstack.requestlog [None req-94453dc5-c760-4200-8dc9-0b1a7b094add admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090758 May 27 03:21:22.252332 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: [pid: 103330|app: 0|req: 38/76] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 03:21:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:22:22.862395 dv-cinder-828806-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 03:22:22.863084 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: Fri May 27 03:22:22 2022 - graceful shutdown triggered... May 27 03:22:22.863826 dv-cinder-828806-4-iscsi devstack@n-api.service[103329]: Gracefully killing worker 1 (pid: 103329)... May 27 03:22:22.864790 dv-cinder-828806-4-iscsi devstack@n-api.service[103330]: Gracefully killing worker 2 (pid: 103330)... May 27 03:22:23.864240 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: worker 1 buried after 1 seconds May 27 03:22:23.864240 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: worker 2 buried after 1 seconds May 27 03:22:23.864240 dv-cinder-828806-4-iscsi devstack@n-api.service[103328]: goodbye to uWSGI. May 27 03:22:23.866627 dv-cinder-828806-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 03:22:23.867512 dv-cinder-828806-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 03:22:23.871575 dv-cinder-828806-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:22:23.893079 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:22:23 2022] *** May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: nodename: dv-cinder-828806-4-iscsi May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: machine: x86_64 May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: clock source: unix May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: pcre jit disabled May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: detected number of CPU cores: 4 May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: current working directory: / May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: detected binary path: /usr/bin/uwsgi-core May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: your processes number limit is 47680 May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: your memory page size is 4096 bytes May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: detected max file descriptor number: 2048 May 27 03:22:23.915337 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: lock engine: pthread robust mutexes May 27 03:22:23.916688 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: thunder lock: enabled May 27 03:22:23.916688 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:22:23.916688 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:22:23.965180 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: Python main interpreter initialized at 0x55bdb219f9c0 May 27 03:22:23.965180 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: python threads support enabled May 27 03:22:23.965180 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: your server socket listen backlog is limited to 100 connections May 27 03:22:23.965180 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: your mercy for graceful operations on workers is 90 seconds May 27 03:22:23.965659 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:22:23.965659 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: *** Operational MODE: preforking *** May 27 03:22:23.965888 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: *** uWSGI is running in multiple interpreter mode *** May 27 03:22:23.965888 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: spawned uWSGI master process (pid: 117748) May 27 03:22:23.966115 dv-cinder-828806-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:22:23.967239 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: spawned uWSGI worker 1 (pid: 117766, cores: 1) May 27 03:22:23.967239 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: spawned uWSGI worker 2 (pid: 117767, cores: 1) May 27 03:22:23.967239 dv-cinder-828806-4-iscsi devstack@n-api.service[117748]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:22:25.133548 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:22:25.135872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 03:22:25.908419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:22:25.908419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: from cryptography.utils import int_from_bytes May 27 03:22:25.908771 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:22:25.908771 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: from cryptography.utils import int_from_bytes May 27 03:22:25.910730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:22:25.910730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: from cryptography.utils import int_from_bytes May 27 03:22:25.911098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:22:25.911098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: from cryptography.utils import int_from_bytes May 27 03:22:28.367092 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:22:28.367790 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:22:28.367881 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:22:28.368232 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:22:28.368457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:22:28.368857 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.369316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.369714 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.370070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.370410 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.370730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.371059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.371385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.371721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.371961 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.372469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.372806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-4-iscsi {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.373295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.373627 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.377576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.377576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.377576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.377576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.377576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.377576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.378087 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.378174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.378692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.379321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.379863 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.380412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.380987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.381528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.381959 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.382319 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.382783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-4-iscsi {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.383150 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.383480 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.383809 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.384245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.384703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.385240 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.385579 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.385919 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.386238 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.386578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.386908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.387330 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.387661 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.387974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.388289 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.388593 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.388925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.389268 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.389595 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.389862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.390176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.390493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.390821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.391136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.391398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.391656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.391982 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.392661 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.392993 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.393311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.393625 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.393937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.394392 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.394568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.394923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.395179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.395512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.395817 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.396171 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.396457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.396824 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.397278 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.397534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.397872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.398218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.398547 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.398855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.399214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.399639 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.399963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.400317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.400827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.401067 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.401570 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.401856 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.402031 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.402533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.402533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.402890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.403271 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.403456 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.403767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.404103 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.404380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.404691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.405248 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.405738 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.406358 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.406834 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.407316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.407789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.408267 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.408755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.409272 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.409756 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.410239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.410703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.411179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.411667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.412133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.412596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.413107 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.413570 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.414044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.414540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.415011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.415474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.416030 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.416782 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.417509 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.418346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.418899 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.419381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.419874 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.420353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.420839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.421323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.421787 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.422257 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.422731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.423219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.423715 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.424194 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.424672 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.425185 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.425517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:22:28.425989 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:22:28.426306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:22:28.426439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.426670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:22:28.426925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:22:28.427238 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.427369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.427624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.427944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.428158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.428277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.428629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.428925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.429081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.429280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.429596 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.429854 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.429972 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.430167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.430479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.430788 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.430899 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-4-iscsi {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.431111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.431440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.431736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.431857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.432155 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.432461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.432568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.432778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.433108 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.433449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.433614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.433927 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.434232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.434358 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.434539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.434876 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.435133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.435243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.435490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.435808 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.436003 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.436109 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.436422 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.436731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.436847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.437153 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-4-iscsi {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.437470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.437626 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.437778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.438094 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.438378 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.438487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.438798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.439105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.439296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.439424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.439753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.440060 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.440180 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.440381 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.440698 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.440979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.441087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.441342 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.441642 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.441845 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.441961 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.442237 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.442551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.442731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.442836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.443140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.443386 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.443596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.443704 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.443994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.444311 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.444434 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.444630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.445160 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.445390 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.445510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.445780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.446142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.446338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.446454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.446676 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.446977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.447279 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.447415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.447742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.448040 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.448300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.448425 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.448648 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.448975 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.449248 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.449364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.449595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.449912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.450140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.450306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.450559 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.450865 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.451149 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.451265 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.451507 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.451814 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.452035 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.452152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.452433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.452737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.452900 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.453065 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.453374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.453667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.453792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.454000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.454302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.454551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.454656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.454848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.455156 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.455423 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.455541 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.455761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.456064 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.456319 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.456440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.456647 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.456974 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.457224 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.457331 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.457564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.457868 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.458081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.458187 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.458457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.458760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.458931 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.459041 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.459351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.459624 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.459742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.459970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.460277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.460489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.460588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.460869 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.461218 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.461339 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.461539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.461846 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.462080 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.462201 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.462456 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.462787 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.463167 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.463281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.463510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.463826 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.464037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.464152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.464437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.464736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.464909 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.465067 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.465375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.465680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.465858 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.465969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.466270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.466575 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.466711 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.466873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.467176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.467476 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.467582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.467773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.468071 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.468353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.468471 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.468690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.469029 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.469257 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.469364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.469625 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.469942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:22:28.470085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.470282 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.470614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.470843 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.470951 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.471255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.471565 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.471693 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.471900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.472220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.472432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.472539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.472828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.473156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.473268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.473471 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.473780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.474018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.474141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.474391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.474708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.474933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.475040 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.475347 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.475634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.475760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.475968 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.476276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.476541 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.476650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.476906 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.477256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.477472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.477579 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.477891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.478183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.478303 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.478644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.478961 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.479070 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.479342 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.479655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.479808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.479965 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.480275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.480538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.480661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.480917 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.481256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.481431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.481570 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.481887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.482173 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.482293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.482498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.482813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.483042 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.483159 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.483443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.483760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.483932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.484073 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.484386 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.484708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.484815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.485042 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.485355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.485613 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.485721 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.485959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.486266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.486479 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.486594 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.486866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.487167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.487337 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.487487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.487834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.488099 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.488208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.488447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.488755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.489075 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.489189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.489407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.489718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.489935 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.490043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.490319 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.490630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.490797 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.490933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.491259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.491544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.491672 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.491859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.492183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.492422 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.492539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.492776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.493116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.493362 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.493484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.493721 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.494079 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.494286 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.494480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.494807 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.495050 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.495166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.495430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.495755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.495979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.496100 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.496376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.496726 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.496895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.497064 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.497388 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.497670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.497778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.497986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.498288 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.498582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.498698 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.498882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.499189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.499490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.499792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.500037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.500155 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.500379 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.500682 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.501026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.501246 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.501362 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.501626 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.501927 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.502118 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.502233 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.502555 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.502844 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.502954 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.503189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.503527 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.503723 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.503829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.504152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.504432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.504541 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.504763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.505118 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.505318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.505424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.505729 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.506018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.506126 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.506344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.506655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.506877 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.506994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.507269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.507594 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.507749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.507903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.508226 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.508489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.508584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.508834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.509203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.509320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.509539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.510015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.510163 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.510438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.510756 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.510974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.511164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.511478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.511739 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.511859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.512092 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.512404 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.512597 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.512703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.513058 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.513329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.513437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.513675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.514000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.514216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.514326 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.514616 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.514924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.515241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.515343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.515569 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.515902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.516218 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.516327 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.516526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.516850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.517186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.517819 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.517920 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.518131 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.518439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.518745 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.518980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.519102 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.519356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.519665 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.519976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.520077 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.520277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.520593 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.520902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.521129 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.521228 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.521535 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.521848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.522072 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.522181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.522470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.522796 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.523054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.523165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.523417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.523724 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.523998 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.524105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.524344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.524937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.524937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.525344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.525702 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.525842 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.526181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.526552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.526664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.526953 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.527279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.527594 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.527737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.527956 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.528269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.528503 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.528604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.528892 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.529238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.529553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.529663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.529863 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.530176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.530573 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.530789 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.531110 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.531438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.531668 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.531763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.532045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.532357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.532662 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.532763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.533050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.533377 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.533815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.533972 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.534304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.534619 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.534812 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.534954 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.535255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.535628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.535905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.536159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.536268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.536567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.536882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.537197 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.537307 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.537502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.537808 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.538117 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.538379 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.538480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.538711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.539015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.539324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.539531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.539631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.539912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.540213 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.540505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.540617 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.540819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.541367 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.541469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.541866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.542167 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.542278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.542543 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.542855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.543136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.543248 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.543452 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.543758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.544103 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.544282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.544425 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.544753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.545098 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.545324 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.545465 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.545758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.546056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.546336 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.546446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.546673 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.546977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.547280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.547490 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.547597 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.547878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.548178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.548468 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.548577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.548782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.549120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.549429 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.549642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.549742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.550025 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.550326 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.550623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.550724 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.550932 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.551234 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.551536 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.551778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.551891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.552135 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.552438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.552745 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.552968 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.553069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.553375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.553676 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.553926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.554028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.554267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.554577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.554883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.555082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.555180 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.555499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.555807 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.556030 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.556147 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.556416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.556845 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.557004 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.557250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.557558 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.557870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.558193 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.558405 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.558516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.558804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.559116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.559367 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.559481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.559713 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.560017 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.560294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.560396 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.560610 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.560916 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.561247 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.561454 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.561553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.561841 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.562165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.562407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.562525 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.562767 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.563074 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.563379 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.563564 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.563715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.564022 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.564384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.564567 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.564678 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.565003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.565336 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.565580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.565689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.565945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.566258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.566521 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.566623 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.566859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.567170 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.567481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.567657 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.567794 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.568080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.568399 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.568651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.568752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.569024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.569347 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.569670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.569868 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.569975 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.570282 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.570586 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.570833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.570944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.571182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.571487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.571798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.571909 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.572125 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.572613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.572893 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.573121 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.573220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.573525 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.573832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.574102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.574203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.574432 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.574737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.575061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.575233 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.575371 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.575668 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.575977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.576227 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.576337 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.576575 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.576878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.577201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.577344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.577650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.577959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.578217 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.578317 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.578557 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.578865 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.579180 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.579351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.579496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.579785 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.580176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.580278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.580496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.580805 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.581146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.581417 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.581533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.581735 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.582042 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.582363 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.582586 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.582686 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.582955 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.583258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584334 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584617 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.584879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.585012 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.585190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.585590 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.585705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.585837 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.585947 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.586187 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.586328 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.586508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.586818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.586927 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.587145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.587264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.587483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.587618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.587819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.587924 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.588231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.588533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.588629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.588705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.588907 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.589110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.589479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.589722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.589883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.590168 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.590338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.590493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.590647 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.590804 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.590960 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.591105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.591295 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.591449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.591602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.591748 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.591899 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.592047 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.592199 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.592386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.592545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.592730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.592924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.593224 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.594216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.594405 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.594580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.594739 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.594902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.595224 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.595377 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.595562 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.595727 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.595880 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.596026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.596026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.596361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.596517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.596670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.596995 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.597151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.597435 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.597625 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.597786 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.597940 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.598095 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.598272 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.598476 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.598476 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.599023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.599171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.599340 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.599563 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.599747 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.599905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.600059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.600211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.600382 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.600582 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.600750 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.600898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.601087 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.601243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.601387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.601546 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.601763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.601911 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.602061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.602211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.602363 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.602522 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.602667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.602810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.602964 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.603118 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.603273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.603821 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.604027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.604174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.604327 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.604473 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.604631 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.604776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.604928 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.605326 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.605493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.605653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.605842 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.605991 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.606134 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.606277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.606429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.606585 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.606740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.606895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.607132 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.607284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.607446 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.607690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.607860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.607860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.608137 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.608137 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.608417 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.608577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.608721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.608986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.609150 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.609310 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.609463 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.609624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.609787 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.609964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.610111 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.610291 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.610449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.610606 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.610759 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.610903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.611054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.611198 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.611386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.611533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.611678 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.611834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.611985 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.612145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.612311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.612486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.612642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.612788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.612939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.613159 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.613319 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.613464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.613643 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.613977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.614143 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.614296 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.614451 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.614597 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.614750 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.614903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.615048 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.615202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.615365 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.615609 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.615768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.615915 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.616067 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.616233 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.616379 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.616523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.616666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.616825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.616991 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.617184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.617333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.617486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.617746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.617900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.618080 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.618238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.618402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.618564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.618710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.618710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.618994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.619139 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.619289 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.619433 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.619583 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.619771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.619929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.620082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.620238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.620382 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.620524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.620667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.620897 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.621088 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.621242 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.621387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.621556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.621711 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.621895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.622058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.622216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.622382 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.622542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.622687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.622830 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.622975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.623138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.623288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.623441 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.623594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.623746 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.624038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.624192 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.624360 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.624506 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.624650 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.624803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.624968 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.625130 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.625294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.625439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.625601 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.625812 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.625999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.626196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.626366 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.626519 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.626671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.627287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.627451 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.627612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.627757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.627909 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.628065 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.628219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.628465 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.628627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.628782 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.629094 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.629260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.629406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.629573 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.629731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.629885 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.630067 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.630216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.630360 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.630519 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.630664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.630817 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.630981 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.631134 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.631279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.631437 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.631590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.631742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.631887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.632040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.632040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.632327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.632479 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.632632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.632783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.632944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.633113 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.633270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.633431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.633576 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.633729 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.633874 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.634218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.634374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.634519 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.634697 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.634850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.635003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.635174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.635329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.635329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.635613 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.635758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.635996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.636157 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.636302 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.636454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.636607 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.636760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.636760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.637120 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.637281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.637281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.637554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.637698 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.637860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.638005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.638148 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.638332 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.638332 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.638725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.638892 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.638892 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.639187 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.639343 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.639494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.639640 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.639794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.639950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.639950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.640248 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.640393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.640536 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.640689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.640689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.640990 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.641164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.641164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.641464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.641610 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.641753 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.641925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.641925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.642598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.642762 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.642907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.643061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.643061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.643334 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.643496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.643496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.643913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.644062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.644359 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.644526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.644526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.644526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645319 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645773 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645926 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.645926 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.646293 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.646475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.646629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.646774 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.646774 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.647125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.647280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.647424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.647618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.647618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.647925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.648077 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.648077 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.648349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.648509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.648509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.648884 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.649068 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.649215 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.649370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.649370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.649645 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.649814 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.649959 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.650103 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.650311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.650466 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.650466 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.650784 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.650937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651669 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651830 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.651985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.652269 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.652412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.652563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.652715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.652715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653051 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653485 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653648 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.653959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.654241 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.654550 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.654550 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.654853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.655006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.655006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.655279 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.655424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.655424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.655725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.655870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.656014 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.656175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.656175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.656543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.656690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.656690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.657166 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.657327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.657497 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.657750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.657750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.658055 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.658200 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.658200 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.658482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.658637 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.658784 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.659026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.659026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.659304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.659464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.659618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.659765 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.659765 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.660080 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.660233 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.660394 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.660556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.660556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661479 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661785 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.661944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.662240 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.662394 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.662582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.662731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.662731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.663013 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.663165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.663165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.663438 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.663590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.663590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.663882 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.664040 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.664186 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.664334 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.664619 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.664779 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.664942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.665114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.665269 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.665416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.665567 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.665722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.665963 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.666124 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.666395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.666560 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.666911 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.667083 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.668592 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.669313 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.669518 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.669608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.669703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.669789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.669873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.669873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670210 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670296 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670546 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670637 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670732 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670817 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.670993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671084 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671270 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671605 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671701 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.671962 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.672045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.672128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.672245 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.672439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.672541 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.672786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.672994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.674008 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.674254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.674403 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.674537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.674537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.674790 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.674790 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.675051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.675051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.675447 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.675603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.675734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.675894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.675894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.676139 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.676295 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.676295 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.676546 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.676686 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.676814 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.677116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.677116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.677380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.677512 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.677512 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.677768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.677895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.678021 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.678148 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.678289 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.678417 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.678696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.678838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.678974 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.679206 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.679407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.679549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.679758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.679945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.680075 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.680186 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.680410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.680692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.680879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.681063 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.681198 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.681327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.681811 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.681980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.682135 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.682278 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.682461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.682823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.682961 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.683089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.683216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.683351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.683487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.683631 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.683766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.683902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.684031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.684166 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.684374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.684579 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.684729 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.684872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.685044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:22:28.685185 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.685457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.685778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.686125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.686455 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.686786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.687206 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.687440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.687758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.688085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.688478 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.688980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.689512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.690006 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.690503 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.690995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.691484 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.691974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.692463 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.693038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.693868 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.694386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.694897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.695413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.695958 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.696387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.696666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.697018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.697554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.698018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.698817 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.698817 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.700062 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.700062 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.700062 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.700462 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.700591 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.700852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.701207 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.701582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.701913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.702234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.702578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.703083 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.703568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.704096 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.704573 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.705091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.705583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.706072 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.706568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.707049 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.707525 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.708027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.708549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.709073 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.709622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.710156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.710549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.711113 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.711444 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.711791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.712133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.712472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.712861 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.713213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.713612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.713923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.714239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.714563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.714882 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.715199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.715532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.715851 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.716167 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.716494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.716877 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.717740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.718287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.718786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.719294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.719804 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.720302 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.720798 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.721351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.721837 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.722321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.722811 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.723337 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.723861 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.724368 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.724838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.725331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.725743 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.726070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.726388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.726728 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.727048 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.727365 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.727684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.728025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.728354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.728695 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.729081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.729350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.729675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.729989 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.730307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.730622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.730943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.731259 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.731576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.731941 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.732276 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.732592 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.732908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.733265 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.733589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.733928 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.734254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.734582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.734939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.735264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.735817 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.736165 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.736500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.736847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.737216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.737535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.737856 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.738174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.738507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.738828 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.739147 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.739468 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.739786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.740101 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.740418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.740737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.741081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.741396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.741710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.742027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.742342 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.742659 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.742981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.743289 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Registered counter for database nova_api May 27 03:22:28.743484 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.743642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.743975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.744333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.744660 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.744995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.745314 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.745627 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.745947 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.746266 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.746604 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.746925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.747237 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.747671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.747993 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.748318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.748646 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.748980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.749316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.749650 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.749968 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.750295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.750614 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.750948 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.751297 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.751635 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.751969 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.752283 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.752594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.752905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.753260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.753586 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.753902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.754213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.754524 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.755628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.755628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.755628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.756131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.756131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.756424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.756600 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.756903 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.757236 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.757543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.757847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.758158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.758472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.758781 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.760658 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.761072 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.761340 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.761678 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.762047 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.762414 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.762750 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.763101 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.763436 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.763781 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.764111 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.764449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.764791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.765151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.765475 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.765824 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.766151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.766290 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:28.766477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.766801 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.767124 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.767785 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.768106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.768991 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.768991 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.769261 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.769436 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.769772 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.770105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.770434 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.770771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.771096 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.771420 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.771742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.772087 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.772385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.772705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.773060 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.773391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.773726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.774064 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.774286 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:28.774428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.774820 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.775043 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.775631 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.775979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.776325 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.776670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.777016 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.777343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.777681 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:22:28.777915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:22:28.830258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.context [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3177609-63d6-4369-942a-1c4f9ce92a70(cell1) {{(pid=117766) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:22:28.834543 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:28.836085 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:28.836199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Registered counter for database nova_api May 27 03:22:28.836881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:28.839249 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:28.841505 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Registered counter for database nova_cell0 May 27 03:22:28.845565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Registered counter for database nova_cell1 May 27 03:22:28.854999 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:28.855871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:28.858669 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:28.861435 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:28.863969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:28.866290 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:28.924208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.context [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3177609-63d6-4369-942a-1c4f9ce92a70(cell1) {{(pid=117767) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:22:28.928527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:28.930152 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:28.930952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:22:28.933042 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:22:28.935075 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Registered counter for database nova_cell0 May 27 03:22:28.939102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Registered counter for database nova_cell1 May 27 03:22:28.946700 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:28.948705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:28.954323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:28.956802 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:29.010741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Registered counter for database nova_cell0 May 27 03:22:29.018376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:29.023768 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:29.105793 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Registered counter for database nova_cell0 May 27 03:22:29.115924 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:22:29.120234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:22:29.337041 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:22:29.344911 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:22:29.438510 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:22:29.446303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:22:29.690934 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:22:29.696969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-bc3ffb7f-a891-44ff-b097-744054a9a247 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:22:29.702266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdb219f9c0 pid: 117766 (default app) May 27 03:22:29.788913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:22:29.795027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-f8b26996-8a0e-4a4a-a3a3-922917874d1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:22:29.800319 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdb219f9c0 pid: 117767 (default app) May 27 03:23:11.677403 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:11.678305 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:11.679039 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:11.679901 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:12.073729 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:12.075516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:12.080663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:12.082095 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:12.734974 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4ecc68d4-2ef5-4e14-b74e-5991a0e217fe tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Action: 'create', calling method: .version_select at 0x7f5e75911c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-426827908"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:13.324219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1879797877", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "networks": [{"uuid": "fa73c53a-cb04-46d3-9e67-3609763bf5fd"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:13.939630 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] validate_networks() for [('fa73c53a-cb04-46d3-9e67-3609763bf5fd', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:23:14.860382 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4ecc68d4-2ef5-4e14-b74e-5991a0e217fe tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.192172 May 27 03:23:14.861331 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1154 bytes} [Fri May 27 03:23:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3195 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 03:23:14.873569 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-902eabc5-b71e-4136-ae3d-31232d11f059 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e7575fb80>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:15.218022 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-902eabc5-b71e-4136-ae3d-31232d11f059 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3" status: 200 len: 344 microversion: 2.1 time: 0.348395 May 27 03:23:15.218431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 2/2] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:14 2022] GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 => generated 344 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:16.236529 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-20ac16a3-d1ea-4276-ab2c-7301bda48970 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e7575fdc0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:16.437532 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-20ac16a3-d1ea-4276-ab2c-7301bda48970 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3" status: 200 len: 345 microversion: 2.1 time: 0.210250 May 27 03:23:16.438497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 3/3] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:16 2022] GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 => generated 345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:16.452574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9b25e986-1583-4201-beb6-2963388d4cf6 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Action: 'create', calling method: .version_select at 0x7f5e75773310>, body: {"snapshot": {"volume_id": "ed791004-aae7-41c5-af55-9d7b9a6b8fa3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1313217705"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:16.618755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:23:16.630252 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:23:16.633117 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:23:16.633823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:23:16.636900 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:23:16.720074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:16.721120 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:16.722893 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:16.724151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:16.822537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Getting quotas for project a0a3ae93f6ab44af93b0538061809b98. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:16.835006 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Getting quotas for user 1b22fa493ae04d5fac13b94cff154eee and project a0a3ae93f6ab44af93b0538061809b98. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:16.863372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:23:16.867878 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:23:17.044682 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8a6cac2e-5cd8-4ea5-864e-2a6973e0f713 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.983510 May 27 03:23:17.052239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 1/4] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 4991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:23:17.071436 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-089d080f-810b-4be6-8d3d-59c2fcf05e81 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:17.072104 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-089d080f-810b-4be6-8d3d-59c2fcf05e81 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:17.098352 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9b25e986-1583-4201-beb6-2963388d4cf6 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.651652 May 27 03:23:17.099628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 4/5] 10.222.0.50 () {60 vars in 1161 bytes} [Fri May 27 03:23:16 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:17.112492 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-26ca8b99-f5ed-4325-a4c1-e32a67513dce tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e75773f70>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:17.308785 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-26ca8b99-f5ed-4325-a4c1-e32a67513dce tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 200 len: 287 microversion: 2.1 time: 0.202471 May 27 03:23:17.314140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 5/6] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:23:17 2022] GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 287 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:17.318941 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ffbe7894-fad7-4d02-9a96-0039c61e390c tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e75773b80>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:17.393823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ffbe7894-fad7-4d02-9a96-0039c61e390c tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.078462 May 27 03:23:17.394472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 6/7] 10.222.0.50 () {58 vars in 1139 bytes} [Fri May 27 03:23:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:17.404880 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-feefb9b8-c294-496a-8992-46c4b4688d16 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e7575f940>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:17.470539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-feefb9b8-c294-496a-8992-46c4b4688d16 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 200 len: 287 microversion: 2.1 time: 0.068764 May 27 03:23:17.475608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 7/8] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:23:17 2022] GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:17.576397 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-089d080f-810b-4be6-8d3d-59c2fcf05e81 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:17.597492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-089d080f-810b-4be6-8d3d-59c2fcf05e81 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1215 microversion: 2.1 time: 0.541457 May 27 03:23:17.604002 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 2/9] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:17 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1215 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:18.486690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-764f0f13-7b9d-49d4-a782-170e8ee6eaf6 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e75783160>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:18.539470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-764f0f13-7b9d-49d4-a782-170e8ee6eaf6 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 200 len: 287 microversion: 2.1 time: 0.059004 May 27 03:23:18.541395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 8/10] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:23:18 2022] GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:18.621400 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-62baca1c-619d-424f-bdde-812710708acc tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:18.622020 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-62baca1c-619d-424f-bdde-812710708acc tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:18.782190 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-62baca1c-619d-424f-bdde-812710708acc tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:18.791364 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-62baca1c-619d-424f-bdde-812710708acc tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1215 microversion: 2.1 time: 0.172463 May 27 03:23:18.793952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 3/11] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:18 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:19.552816 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-53dafc6f-4c06-4db0-8fe0-50c0df921bfe tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e7575faf0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:19.627260 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-53dafc6f-4c06-4db0-8fe0-50c0df921bfe tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 200 len: 287 microversion: 2.1 time: 0.078398 May 27 03:23:19.628632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 9/12] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:23:19 2022] GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:19.812324 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:19.812942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:19.835517 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:19.836198 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:19.837182 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:19.840739 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:20.446467 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:20.471446 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-69de6223-73ed-4e0a-a1be-6f8b36cad94e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1219 microversion: 2.1 time: 0.662928 May 27 03:23:20.481706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 4/13] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:19 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1219 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:20.643999 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d4f02759-34ad-4433-ad96-e743feba52af tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e757734c0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:20.717306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d4f02759-34ad-4433-ad96-e743feba52af tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 200 len: 288 microversion: 2.1 time: 0.080643 May 27 03:23:20.718196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 10/14] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:23:20 2022] GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:20.730393 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e77eea55-a7a6-41e3-b160-d164aa6d4f32 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e74648940>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:21.014390 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e77eea55-a7a6-41e3-b160-d164aa6d4f32 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 202 len: 0 microversion: 2.1 time: 0.288715 May 27 03:23:21.015099 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 5/15] 10.222.0.50 () {58 vars in 1253 bytes} [Fri May 27 03:23:20 2022] DELETE /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:23:21.024606 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d2c25228-45de-4d40-b0dc-1d89d7c6220e tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e75773940>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:21.073271 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d2c25228-45de-4d40-b0dc-1d89d7c6220e tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 200 len: 287 microversion: 2.1 time: 0.053075 May 27 03:23:21.074747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 11/16] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:23:21 2022] GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:21.489551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:21.490493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:21.501782 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:21.505200 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:21.506198 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:21.507888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:22.092111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9fc7e06d-a88e-42d9-abdf-057a6388ce16 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e757833a0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:22.167831 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-9fc7e06d-a88e-42d9-abdf-057a6388ce16 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] HTTP exception thrown: Snapshot 8024f3d6-560e-4564-8aee-92d107a2e2b7 could not be found. May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9fc7e06d-a88e-42d9-abdf-057a6388ce16 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Request method failure captured: May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 HTTP/1.1 May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQfr6y0c-X1SZEw-hbjPnfO8Na5fXK9jgAbl6vouSBZHhPkW9Bw1fy3PX9AWCUGs70UW-YJAf7N8qv7Po4o1Y9iom7w-4I3tgcHvbObC37XUa_sny_JcWsJVgccLg8Q8fEVwMftOpYULj6-m9Jx7bW3aPQGAldINI4MxVWi4hbCstg May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:23:22.173409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 0731eb80ac2f4eae82a8aee6454c3840 May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Snapshot 8024f3d6-560e-4564-8aee-92d107a2e2b7 could not be found. May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '8024f3d6-560e-4564-8aee-92d107a2e2b7'} May 27 03:23:22.174591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8024f3d6-560e-4564-8aee-92d107a2e2b7 could not be found. (HTTP 404) (Request-ID: req-fb654633-1f36-456a-964d-5b1038f98cb1) May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:23:22.175357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:22.176327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8024f3d6-560e-4564-8aee-92d107a2e2b7 could not be found. May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 03:23:22.177364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8024f3d6-560e-4564-8aee-92d107a2e2b7 could not be found. May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8024f3d6-560e-4564-8aee-92d107a2e2b7 could not be found. May 27 03:23:22.178502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:23:22.181019 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9fc7e06d-a88e-42d9-abdf-057a6388ce16 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Returning 404 to user: Snapshot 8024f3d6-560e-4564-8aee-92d107a2e2b7 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:23:22.182078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9fc7e06d-a88e-42d9-abdf-057a6388ce16 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7" status: 404 len: 111 microversion: 2.1 time: 0.099678 May 27 03:23:22.186145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 12/17] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:23:22 2022] GET /compute/v2.1/os-snapshots/8024f3d6-560e-4564-8aee-92d107a2e2b7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:23:22.201984 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c68fc631-e770-4c66-bd3c-790848750b39 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e756e13a0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:22.359499 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:22.368082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-33e3b12a-3781-4374-9ebc-77d2f739a2f7 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1275 microversion: 2.1 time: 0.882831 May 27 03:23:22.370848 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 6/18] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:21 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1275 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:22.418888 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c68fc631-e770-4c66-bd3c-790848750b39 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3" status: 202 len: 0 microversion: 2.1 time: 0.230738 May 27 03:23:22.420093 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 13/19] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:23:22 2022] DELETE /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:23:22.428575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a9438957-c1c6-46e6-a54a-b9886d3e8c63 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e7456c9d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:22.553232 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a9438957-c1c6-46e6-a54a-b9886d3e8c63 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3" status: 200 len: 344 microversion: 2.1 time: 0.128895 May 27 03:23:22.553805 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 7/20] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:22 2022] GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:23.387809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:23.388637 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:23.440750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:23.444524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:23.447035 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:23.449519 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:23.565961 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9a1cfbbc-33de-4324-ae85-6f8f9b77ba8e tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e745785e0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:23.639818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-9a1cfbbc-33de-4324-ae85-6f8f9b77ba8e tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] HTTP exception thrown: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9a1cfbbc-33de-4324-ae85-6f8f9b77ba8e tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Request method failure captured: May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 HTTP/1.1 May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQfr6y0c-X1SZEw-hbjPnfO8Na5fXK9jgAbl6vouSBZHhPkW9Bw1fy3PX9AWCUGs70UW-YJAf7N8qv7Po4o1Y9iom7w-4I3tgcHvbObC37XUa_sny_JcWsJVgccLg8Q8fEVwMftOpYULj6-m9Jx7bW3aPQGAldINI4MxVWi4hbCstg May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:23:23.644350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 0731eb80ac2f4eae82a8aee6454c3840 May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'ed791004-aae7-41c5-af55-9d7b9a6b8fa3'} May 27 03:23:23.645719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. (HTTP 404) (Request-ID: req-2982bf4a-2707-4425-bca4-b26ca23c3e37) May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.646440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:23.648725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:23:23.650380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9a1cfbbc-33de-4324-ae85-6f8f9b77ba8e tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Returning 404 to user: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9a1cfbbc-33de-4324-ae85-6f8f9b77ba8e tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3" status: 404 len: 109 microversion: 2.1 time: 0.084195 May 27 03:23:23.651523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 8/21] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:23 2022] GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:23:23.676153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c0ecd5b8-e05b-4175-b821-8d88375b0cb8 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e744e71f0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:23.759807 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-c0ecd5b8-e05b-4175-b821-8d88375b0cb8 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] HTTP exception thrown: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c0ecd5b8-e05b-4175-b821-8d88375b0cb8 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Request method failure captured: May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 HTTP/1.1 May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQfr6y0c-X1SZEw-hbjPnfO8Na5fXK9jgAbl6vouSBZHhPkW9Bw1fy3PX9AWCUGs70UW-YJAf7N8qv7Po4o1Y9iom7w-4I3tgcHvbObC37XUa_sny_JcWsJVgccLg8Q8fEVwMftOpYULj6-m9Jx7bW3aPQGAldINI4MxVWi4hbCstg May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:23:23.761865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 0731eb80ac2f4eae82a8aee6454c3840 May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'ed791004-aae7-41c5-af55-9d7b9a6b8fa3'} May 27 03:23:23.762866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. (HTTP 404) (Request-ID: req-de97cc54-1556-45c7-9efb-1bd409fe7b05) May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.763550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:23:23.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:23:23.765344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c0ecd5b8-e05b-4175-b821-8d88375b0cb8 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Returning 404 to user: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:23:23.766538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c0ecd5b8-e05b-4175-b821-8d88375b0cb8 tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3" status: 404 len: 109 microversion: 2.1 time: 0.100484 May 27 03:23:23.769996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 9/22] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:23:23 2022] DELETE /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:23:23.783264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-afa9e0f9-4d8d-41c8-88dc-ad29710c458b tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Calling method '.version_select at 0x7f5e760f33a0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:23.889264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-afa9e0f9-4d8d-41c8-88dc-ad29710c458b tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] HTTP exception thrown: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-afa9e0f9-4d8d-41c8-88dc-ad29710c458b tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Request method failure captured: May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 HTTP/1.1 May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQfr6y0c-X1SZEw-hbjPnfO8Na5fXK9jgAbl6vouSBZHhPkW9Bw1fy3PX9AWCUGs70UW-YJAf7N8qv7Po4o1Y9iom7w-4I3tgcHvbObC37XUa_sny_JcWsJVgccLg8Q8fEVwMftOpYULj6-m9Jx7bW3aPQGAldINI4MxVWi4hbCstg May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:23:23.891581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1f5e434c7534753aea9c96091527cd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: d1f5e434c7534753aea9c96091527cd1 May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1303429240 May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 0731eb80ac2f4eae82a8aee6454c3840 May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1303429240-project May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'ed791004-aae7-41c5-af55-9d7b9a6b8fa3'} May 27 03:23:23.892703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. (HTTP 404) (Request-ID: req-bace97fb-b783-4313-ab8f-71f9bdd3e9d2) May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.893448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:23.894418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:23:23.895505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-afa9e0f9-4d8d-41c8-88dc-ad29710c458b tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] Returning 404 to user: Volume ed791004-aae7-41c5-af55-9d7b9a6b8fa3 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-afa9e0f9-4d8d-41c8-88dc-ad29710c458b tempest-VolumesSnapshotsTestJSON-1303429240 tempest-VolumesSnapshotsTestJSON-1303429240-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3" status: 404 len: 109 microversion: 2.1 time: 0.124444 May 27 03:23:23.896577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 10/23] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:23 2022] GET /compute/v2.1/os-volumes/ed791004-aae7-41c5-af55-9d7b9a6b8fa3 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:23:24.712979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:24.773850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-792b4c20-c06c-492d-a6bb-2b456c50c286 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1273 microversion: 2.1 time: 1.387638 May 27 03:23:24.776156 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 14/24] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:23 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1273 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:25.791626 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:25.792211 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:25.810997 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:25.811716 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:25.812637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:25.813231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:26.765350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:27.898745 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:27.912679 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-08f09119-2348-45ee-a5b7-d00eefa66ecf tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 2.125241 May 27 03:23:27.913554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 11/25] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:25 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:28.537304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1832511845", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:28.798921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] validate_networks() for [('ee2ac450-e56e-4c1d-8d15-c8bfd50e2024', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:23:28.936350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:28.937680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:28.939854 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=10 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:28.956824 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:28.964621 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:28.965775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:28.966382 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:30.944228 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:30.961010 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-65ed9ff5-3a14-4a3d-b229-9c9006a37b44 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 2.022934 May 27 03:23:30.968678 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 12/26] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:28 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:32.004416 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:32.007421 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:32.043144 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:32.045037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:32.048905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:32.053665 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:33.297310 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:33.319259 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-47c9d12e-b071-4fc9-8bd2-2db72335cae2 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 1.337139 May 27 03:23:33.319865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 13/27] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:31 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:34.022915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1b236f12-fd4e-4719-b5e4-e009e7dcb495 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Action: 'create', calling method: .version_select at 0x7f5e7458b310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1524704623", "metadata": {"Type": "work"}}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:34.562574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:23:34.563713 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:23:34.564348 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:23:34.564892 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:23:34.565958 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:23:34.592697 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:34.595360 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:34.601288 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:34.609692 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:34.709256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for project 6db8193dcee944008c7b41889bfa67a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:34.722428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for user 468a46d55bd342739b9cd78bcd3a77fc and project 6db8193dcee944008c7b41889bfa67a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:34.755698 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:23:34.758836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:23:34.997734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f47509c6-7b35-48f5-a54c-081d0e0f0922 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.892354 May 27 03:23:35.004044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 15/28] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:23:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 6899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:23:35.033723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:35.034516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:35.079715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:35.080226 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:35.094206 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:35.095105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:35.480537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1b236f12-fd4e-4719-b5e4-e009e7dcb495 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.159224 May 27 03:23:35.481329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 14/29] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 03:23:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2161 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 03:23:35.824318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-b458f1eb-933f-4562-b3c7-fc6a3c072cd3 req-a2b8078a-03a6-4729-9153-57c74192e555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddacdbc-778d-43a4-9781-bc1bfec238e4", "tag": "80ce9414-7ad7-4080-9680-4d84a0a632b6"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:35.850119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-b458f1eb-933f-4562-b3c7-fc6a3c072cd3 req-a2b8078a-03a6-4729-9153-57c74192e555 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:35.850584 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-b458f1eb-933f-4562-b3c7-fc6a3c072cd3 req-a2b8078a-03a6-4729-9153-57c74192e555 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:35.901092 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-b458f1eb-933f-4562-b3c7-fc6a3c072cd3 req-a2b8078a-03a6-4729-9153-57c74192e555 service nova] Creating event network-changed:80ce9414-7ad7-4080-9680-4d84a0a632b6 for instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 on hv-cinder-82880 May 27 03:23:35.901656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-b458f1eb-933f-4562-b3c7-fc6a3c072cd3 req-a2b8078a-03a6-4729-9153-57c74192e555 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117767) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 03:23:35.904136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-092b4988-7b53-4dc3-962d-fc01b6f44a10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:35.905638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-092b4988-7b53-4dc3-962d-fc01b6f44a10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:35.906999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-092b4988-7b53-4dc3-962d-fc01b6f44a10 None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:35.907937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-092b4988-7b53-4dc3-962d-fc01b6f44a10 None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:35.920968 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.compute.rpcapi [None req-092b4988-7b53-4dc3-962d-fc01b6f44a10 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 03:23:35.923059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-092b4988-7b53-4dc3-962d-fc01b6f44a10 None None] Releasing lock "compute-rpcapi-router" {{(pid=117767) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 03:23:35.973995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-092b4988-7b53-4dc3-962d-fc01b6f44a10 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483209 May 27 03:23:35.985818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 15/30] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:36.020768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c7ed5552-fa1c-490e-9680-da48d451f976 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:36.021862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c7ed5552-fa1c-490e-9680-da48d451f976 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:36.234335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c7ed5552-fa1c-490e-9680-da48d451f976 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:36.244733 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c7ed5552-fa1c-490e-9680-da48d451f976 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1222 microversion: 2.1 time: 0.256591 May 27 03:23:36.255474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 16/31] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:35 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:36.400829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:36.421508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8bdc44fc-92a9-43ef-99e2-f18c32dc8429 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 1.414253 May 27 03:23:36.422300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 16/32] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:35 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:36.463834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-27585f84-e365-4197-9c68-514d0c128bb4 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Calling method '.version_select at 0x7f5e74d45310>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:36.642329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-27585f84-e365-4197-9c68-514d0c128bb4 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc" status: 200 len: 354 microversion: 2.1 time: 0.196842 May 27 03:23:36.643109 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 17/33] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:36 2022] GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:36.650186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1686809007", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:36.722544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1e88d626-2505-4af5-ad7c-cfb62e95de2c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'create', calling method: .version_select at 0x7f5e744e7040>, body: {"keypair": {"name": "tempest-keypair-471684052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIixBwYb46bk9KxqizrYgZjKk8Uh74s1BBq6zuVXTGi1QEGzLoRahh2TDI2Ko+BpwhDIOMlJahayBkSFNHaN7vLfBPeoHQg9BtsxWBlZuiZhaCwUrsbDCuulv8cLgOdJDA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:36.762993 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-1e88d626-2505-4af5-ad7c-cfb62e95de2c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for project 9351d2e0e0e14585820951a9398b35f4. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:36.772284 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-1e88d626-2505-4af5-ad7c-cfb62e95de2c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for user 19457c759f0b4f5cbc530364af1f47d7 and project 9351d2e0e0e14585820951a9398b35f4. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:36.819322 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] validate_networks() for [('ee2ac450-e56e-4c1d-8d15-c8bfd50e2024', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:23:36.858422 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1e88d626-2505-4af5-ad7c-cfb62e95de2c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.601430 May 27 03:23:36.859037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 17/34] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:23:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:36.876653 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8dffb317-7696-406a-8939-9fc462161a7b tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Calling method '.version_select at 0x7f5e7458b700>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:37.068168 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8dffb317-7696-406a-8939-9fc462161a7b tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc" status: 200 len: 354 microversion: 2.1 time: 0.207765 May 27 03:23:37.069706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 18/35] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:36 2022] GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:37.092141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-63522f7b-3647-40d9-af56-9c15d0f91a68 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Calling method '.version_select at 0x7f5e7458b5e0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:37.275440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-63522f7b-3647-40d9-af56-9c15d0f91a68 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc" status: 202 len: 0 microversion: 2.1 time: 0.187757 May 27 03:23:37.279599 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 19/36] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:23:37 2022] DELETE /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:23:37.285867 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d3abeab4-cd81-42b9-9343-7b77e9d6abd8 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Calling method '.version_select at 0x7f5e744c25e0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:37.476597 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d3abeab4-cd81-42b9-9343-7b77e9d6abd8 tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc" status: 200 len: 353 microversion: 2.1 time: 0.195176 May 27 03:23:37.478198 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 20/37] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:37 2022] GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:37.587281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3ac514e8-a7c1-4f57-8024-257447c3f47e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'create', calling method: .version_select at 0x7f5e744c2c10>, body: {"keypair": {"name": "tempest-keypair-1744236539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9ILMi4Sa7gvRG5LsuZK3UMI4KWOqQ5JDKo2EoQKI8HVG3hO01Use30rGp8h3KRhkq0HcDOrDC5/VtvBz3rQliRpfgpa/y1a7IIsY2u2Hkq6Kscg0hA22RXcNRa8wA0HA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:37.620825 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-3ac514e8-a7c1-4f57-8024-257447c3f47e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:37.626022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-3ac514e8-a7c1-4f57-8024-257447c3f47e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for user dd9938d83dc84ae494310741e2cba2ec and project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:37.662191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3ac514e8-a7c1-4f57-8024-257447c3f47e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.182449 May 27 03:23:37.663292 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 21/38] 10.222.0.50 () {62 vars in 1199 bytes} [Fri May 27 03:23:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 03:23:37.670605 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:37.673642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:37.684492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:37.685916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:37.687219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:37.687815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:38.348869 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:38.357890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c4739016-38ed-41c7-8930-5dd847b7a727 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.693202 May 27 03:23:38.367555 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 22/39] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:37 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:38.491683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9adf88f2-e2b1-4c75-98bd-90151e7e033f tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Calling method '.version_select at 0x7f5e7458bb80>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:38.537212 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-9adf88f2-e2b1-4c75-98bd-90151e7e033f tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] HTTP exception thrown: Volume 4fe58321-b954-4593-976e-6132cb6f36dc could not be found. May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9adf88f2-e2b1-4c75-98bd-90151e7e033f tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Request method failure captured: May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc HTTP/1.1 May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ0QglVoRJ5CelU7NcRFuxBSCxgQccHZRV_rWdG5-xBR3aIKKEAENH23xm0rHR9_wBwUB8E_gfQZBGB6NQ6SoqZcSWeIncPBySSJYbarnkwdB2gSwzkvwRpHPh2RUCSnmFPpIfuPRYJyqnzpWxDmsL574PAvEu4I0eyGtxdtwpF_Vs May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: f7a93f7132614f2093ab91d2b205f4e9 May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesGetTestJSON-2140628732 May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:23:38.539469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7a93f7132614f2093ab91d2b205f4e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f7a93f7132614f2093ab91d2b205f4e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f7a93f7132614f2093ab91d2b205f4e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f7a93f7132614f2093ab91d2b205f4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesGetTestJSON-2140628732 May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: f7a93f7132614f2093ab91d2b205f4e9 May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesGetTestJSON-2140628732 May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesGetTestJSON-2140628732-project May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 2add2be353aa46d5ab7e6c02b26f51f7 May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesGetTestJSON-2140628732-project May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Volume 4fe58321-b954-4593-976e-6132cb6f36dc could not be found. May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '4fe58321-b954-4593-976e-6132cb6f36dc'} May 27 03:23:38.540984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4fe58321-b954-4593-976e-6132cb6f36dc could not be found. (HTTP 404) (Request-ID: req-10a7db85-c9b2-48f0-92be-9fc51ed0b840) May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:38.541692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:23:38.542879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4fe58321-b954-4593-976e-6132cb6f36dc could not be found. May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:23:38.543815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4fe58321-b954-4593-976e-6132cb6f36dc could not be found. May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4fe58321-b954-4593-976e-6132cb6f36dc could not be found. May 27 03:23:38.544818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:23:38.547827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9adf88f2-e2b1-4c75-98bd-90151e7e033f tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] Returning 404 to user: Volume 4fe58321-b954-4593-976e-6132cb6f36dc could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:23:38.548917 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9adf88f2-e2b1-4c75-98bd-90151e7e033f tempest-VolumesGetTestJSON-2140628732 tempest-VolumesGetTestJSON-2140628732-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc" status: 404 len: 109 microversion: 2.1 time: 0.061166 May 27 03:23:38.550035 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 23/40] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:23:38 2022] GET /compute/v2.1/os-volumes/4fe58321-b954-4593-976e-6132cb6f36dc => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:23:39.056653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:23:39.057782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:23:39.058809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:23:39.059373 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:23:39.059948 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:23:39.109078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:39.111716 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:39.116919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:39.121394 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:39.196464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for project 6db8193dcee944008c7b41889bfa67a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:39.216222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for user 468a46d55bd342739b9cd78bcd3a77fc and project 6db8193dcee944008c7b41889bfa67a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:39.250653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:23:39.255431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:23:39.452471 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7c051bb2-1a95-484c-a31c-54d9a368a42f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.807512 May 27 03:23:39.457014 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 18/41] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:23:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:23:39.475279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:39.477929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:39.489055 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:39.489976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:39.490762 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:39.491202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:39.786620 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-30be1117-304d-4084-bccd-76710c368243 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: .version_select at 0x7f5e744c21f0>, body: {"keypair": {"name": "tempest-keypair-1998157759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq9+SLNcNegKXMTdm//0sOuQkNukXD7UGDJwXLmIq8/Jnsat4tFjY3zL4EVUCCb8kjrjMFWMj3Bvk2Wda8tToPEXfOsdIihlQw9VbEcJAwwA6AIp9r0OMYT9M/nKyBLVA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:39.820029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-30be1117-304d-4084-bccd-76710c368243 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:39.829602 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-30be1117-304d-4084-bccd-76710c368243 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:39.922202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-30be1117-304d-4084-bccd-76710c368243 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.590123 May 27 03:23:39.925151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 24/42] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:23:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:39.945070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b5f51b77-f0b5-4807-a65b-8139a5a4d577 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:39.948459 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b5f51b77-f0b5-4807-a65b-8139a5a4d577 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:40.197311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5f51b77-f0b5-4807-a65b-8139a5a4d577 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:40.213578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b5f51b77-f0b5-4807-a65b-8139a5a4d577 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1222 microversion: 2.1 time: 0.285372 May 27 03:23:40.216217 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 25/43] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:39 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1222 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:40.399071 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:40.410613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6343b8e7-3c5d-4763-8356-d906a19bd6e6 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.943779 May 27 03:23:40.413356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 19/44] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:39 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:41.234653 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:41.235993 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:41.249153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:41.249742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:41.259482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:41.260317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:41.428319 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:41.429494 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:41.442633 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:41.443533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:41.444509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:41.447044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:41.738891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:41.750735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e8246a5d-2c17-4c94-b5d9-e055745bdf2c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1274 microversion: 2.1 time: 0.518245 May 27 03:23:41.751579 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 26/45] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:41 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1274 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:41.965505 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:41.977629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fba7f494-b816-4cb1-a116-e8de53467f59 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.552209 May 27 03:23:41.979632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 20/46] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:41 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:42.771760 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:42.772387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:42.790857 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:42.794864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:42.795591 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:42.796872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:42.797644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:42.891038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=49 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:42.997172 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:42.998220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:43.012591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:43.012993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:43.018669 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:43.019254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:43.666572 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:43.679380 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6d04136d-16d5-436f-af4f-809ba82d4552 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.686689 May 27 03:23:43.681428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 21/47] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:42 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:44.304808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:44.322679 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3552cd5f-f866-4660-94c2-7d2ad2ef2eba tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1280 microversion: 2.1 time: 1.556406 May 27 03:23:44.339093 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 27/48] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:42 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1280 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:44.700509 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:44.703828 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:44.721228 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:44.723398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:44.728296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:44.733713 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:44.845121 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-f8d60dd5-483d-40c7-b6c0-3762333b7475 req-d15ab7fb-4d6f-4a62-9ed0-d209032422fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0b7be0-94f6-463c-ae31-1fdb017d059a", "tag": "6d9acc3b-ba55-4e78-9bbb-cb5a5ce850ef"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:44.877005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-f8d60dd5-483d-40c7-b6c0-3762333b7475 req-d15ab7fb-4d6f-4a62-9ed0-d209032422fe service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:44.879407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-f8d60dd5-483d-40c7-b6c0-3762333b7475 req-d15ab7fb-4d6f-4a62-9ed0-d209032422fe service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:44.925812 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-f8d60dd5-483d-40c7-b6c0-3762333b7475 req-d15ab7fb-4d6f-4a62-9ed0-d209032422fe service nova] Creating event network-changed:6d9acc3b-ba55-4e78-9bbb-cb5a5ce850ef for instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a on hv-cinder-82880 May 27 03:23:44.926348 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-f8d60dd5-483d-40c7-b6c0-3762333b7475 req-d15ab7fb-4d6f-4a62-9ed0-d209032422fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=117766) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 03:23:44.929158 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d30fd2a-d599-4ec0-8637-6eacd3541c9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:44.929612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d30fd2a-d599-4ec0-8637-6eacd3541c9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:44.942811 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d30fd2a-d599-4ec0-8637-6eacd3541c9e None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:44.943274 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d30fd2a-d599-4ec0-8637-6eacd3541c9e None None] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:44.968699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.compute.rpcapi [None req-4d30fd2a-d599-4ec0-8637-6eacd3541c9e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 03:23:44.969686 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d30fd2a-d599-4ec0-8637-6eacd3541c9e None None] Releasing lock "compute-rpcapi-router" {{(pid=117766) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 03:23:45.015843 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4d30fd2a-d599-4ec0-8637-6eacd3541c9e None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436012 May 27 03:23:45.016832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 22/49] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:45.355769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:45.356616 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:45.368663 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:45.370096 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:45.373883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:45.375723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:45.522873 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:45.532252 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e123a95-e5e9-49bd-95ef-c6531b9bbb21 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.837825 May 27 03:23:45.536422 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 28/50] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:44 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:45.632080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:45.647075 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-62463acf-a21e-4cb4-9136-38749cb26810 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1280 microversion: 2.1 time: 0.295706 May 27 03:23:45.651748 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 23/51] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:45 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1280 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:45.902188 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1410866727", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc2d2605-cf0b-41cc-a4d1-c3c28ec94860"}], "security_groups": [{"name": "tempest-securitygroup--1415753079"}], "key_name": "tempest-keypair-471684052", "user_data": "}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:45.928691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:46.256684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] validate_networks() for [('cc2d2605-cf0b-41cc-a4d1-c3c28ec94860', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:23:46.550475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:46.551860 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:46.559950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:46.560397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:46.573417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:46.574274 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:47.113029 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:47.128215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-57c70d01-9c2f-4f7d-a5db-c27f8d12a052 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.581964 May 27 03:23:47.130725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 24/52] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:46 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:47.136922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:47.138176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:47.157415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:47.157913 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:47.161837 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:47.162394 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:47.857255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:47.869178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d56489b8-d0f2-4d46-8b2c-1a65d2a28c61 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.737029 May 27 03:23:47.870015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 25/53] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:47 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:47.890149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1484862940", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9235750b-3863-4242-97a7-a4cb52643ca2"}], "security_groups": [{"name": "tempest-securitygroup--1846666146"}], "key_name": "tempest-keypair-1744236539", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:48.062126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:23:48.063165 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:23:48.063828 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:23:48.065933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:23:48.066416 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:23:48.089126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:48.090410 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:48.091992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:48.094382 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:48.177410 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for project 9351d2e0e0e14585820951a9398b35f4. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:48.177650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] validate_networks() for [('9235750b-3863-4242-97a7-a4cb52643ca2', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:23:48.190637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for user 19457c759f0b4f5cbc530364af1f47d7 and project 9351d2e0e0e14585820951a9398b35f4. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:48.229575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:23:48.235720 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:23:48.410332 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-55515868-6523-4dc7-ad95-e1fd85baea9d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.513182 May 27 03:23:48.418304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 29/54] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:23:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:23:48.426140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:48.437361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:48.466827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:48.469734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:48.471296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:48.472013 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:49.212265 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:49.220623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-641564ba-7df8-470c-af58-58285e7e6e9c tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.801050 May 27 03:23:49.231500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 30/55] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:48 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:49.239105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=12 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:49.244485 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2a4263bd-2490-4f33-83b5-5f08041894ce tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:49.256025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2a4263bd-2490-4f33-83b5-5f08041894ce tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:49.470506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2a4263bd-2490-4f33-83b5-5f08041894ce tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:49.487370 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2a4263bd-2490-4f33-83b5-5f08041894ce tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1237 microversion: 2.1 time: 0.254113 May 27 03:23:49.492051 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 31/56] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:49 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1237 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:49.511410 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:49.515965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:49.530639 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:49.531959 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:49.533185 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:49.534109 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:49.744981 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:23:49.745628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:23:49.746239 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:23:49.746954 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:23:49.751175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:23:49.782345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:49.783093 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:49.785131 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:49.785736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:49.839791 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:49.849533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for user dd9938d83dc84ae494310741e2cba2ec and project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:49.882540 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:23:49.893003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:23:49.965942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b1d14404-a49a-45b5-a413-9483b4da6d5e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.085234 May 27 03:23:49.966743 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 26/57] 10.222.0.50 () {62 vars in 1187 bytes} [Fri May 27 03:23:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 03:23:49.984919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1672055150", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e861f168-e1a5-4542-8ee4-9759fa17a578"}], "security_groups": [{"name": "tempest-securitygroup--601583134"}], "key_name": "tempest-keypair-1998157759", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:50.123303 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] validate_networks() for [('e861f168-e1a5-4542-8ee4-9759fa17a578', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:23:50.124595 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:50.136229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d5b88c79-5f9e-41c1-acd8-5f200987657d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.642355 May 27 03:23:50.139560 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 32/58] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:49 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:50.157582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-191289e2-5dbc-4766-9f11-202e50b366d9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:50.158369 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-191289e2-5dbc-4766-9f11-202e50b366d9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:50.333166 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-191289e2-5dbc-4766-9f11-202e50b366d9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:50.364271 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-191289e2-5dbc-4766-9f11-202e50b366d9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:50.371007 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-191289e2-5dbc-4766-9f11-202e50b366d9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:50.373400 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-191289e2-5dbc-4766-9f11-202e50b366d9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1282 microversion: 2.20 time: 0.220274 May 27 03:23:50.374629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 33/59] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:50 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:50.557202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-5ec71acc-6d7b-4f5b-baf2-9fa388d45825 req-6ecb16fe-76da-4b1d-9ce6-5b946d11a403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddacdbc-778d-43a4-9781-bc1bfec238e4", "name": "network-vif-plugged", "status": "completed", "tag": "80ce9414-7ad7-4080-9680-4d84a0a632b6"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:50.619189 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5ec71acc-6d7b-4f5b-baf2-9fa388d45825 req-6ecb16fe-76da-4b1d-9ce6-5b946d11a403 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:50.619755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5ec71acc-6d7b-4f5b-baf2-9fa388d45825 req-6ecb16fe-76da-4b1d-9ce6-5b946d11a403 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:50.681789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-5ec71acc-6d7b-4f5b-baf2-9fa388d45825 req-6ecb16fe-76da-4b1d-9ce6-5b946d11a403 service nova] Creating event network-vif-plugged:80ce9414-7ad7-4080-9680-4d84a0a632b6 for instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 on hv-cinder-82880 May 27 03:23:50.689092 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-5ec71acc-6d7b-4f5b-baf2-9fa388d45825 req-6ecb16fe-76da-4b1d-9ce6-5b946d11a403 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296463 May 27 03:23:50.690650 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 34/60] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:50.697938 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-44934166-ab94-44e3-b431-f3c275f662fe req-27b72295-f995-43ff-abc7-42dda133a8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "126a653e-c2f9-4fad-9401-b165bddb395d", "tag": "93f8d1e6-7ba3-465b-83b0-41aabb82cf05"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:50.709051 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-44934166-ab94-44e3-b431-f3c275f662fe req-27b72295-f995-43ff-abc7-42dda133a8ad service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:50.709877 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-44934166-ab94-44e3-b431-f3c275f662fe req-27b72295-f995-43ff-abc7-42dda133a8ad service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:50.745172 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-44934166-ab94-44e3-b431-f3c275f662fe req-27b72295-f995-43ff-abc7-42dda133a8ad service nova] Creating event network-changed:93f8d1e6-7ba3-465b-83b0-41aabb82cf05 for instance 126a653e-c2f9-4fad-9401-b165bddb395d on hv-cinder-82880 May 27 03:23:50.759132 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-44934166-ab94-44e3-b431-f3c275f662fe req-27b72295-f995-43ff-abc7-42dda133a8ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066768 May 27 03:23:50.760392 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 35/61] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:50.767888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:50.768813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:50.778972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:50.804615 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:50.808409 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:50.812526 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.256633 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:51.268082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d4e69516-f3fd-415b-a6aa-d7b85a458193 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.505602 May 27 03:23:51.268897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 36/62] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:50 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:51.282975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:51.283666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:51.290014 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.290455 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.291435 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.292042 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.395497 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:51.410174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8bbbab7e-915b-4130-adb8-3cd0ba128d53 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1295 microversion: 2.1 time: 0.130841 May 27 03:23:51.412578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 37/63] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:51 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1295 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:51.421489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:51.422269 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:51.430131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.430586 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.431448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.432248 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.453696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:23:51.454284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:23:51.455171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:23:51.455725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:23:51.456293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:23:51.485677 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.486529 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.487770 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.488341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.513881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:23:51.519921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:23:51.535525 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:23:51.538482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:23:51.675625 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c5dcf22e-70c7-439d-acfd-9bd1ec50abb3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.707642 May 27 03:23:51.687829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 27/64] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:23:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:23:51.701435 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:51.702845 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:51.714045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.716139 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.716320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:51.717940 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:51.718594 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:51.727749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-67afb1d8-ef12-4a9b-b19b-b97f2da66058 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.312448 May 27 03:23:51.728385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 38/65] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:51 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:51.732911 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0b6b2042-55c7-4ac6-872e-7888e6e56ed8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:51.741855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0b6b2042-55c7-4ac6-872e-7888e6e56ed8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:51.850239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0b6b2042-55c7-4ac6-872e-7888e6e56ed8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:51.860027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0b6b2042-55c7-4ac6-872e-7888e6e56ed8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1242 microversion: 2.1 time: 0.130428 May 27 03:23:51.870562 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 39/66] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:51 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:51.875758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:51.914937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:51.920327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:51.921703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f95212ff-2f06-4ee1-87ea-cf5d5c29ca24 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1342 microversion: 2.20 time: 0.230240 May 27 03:23:51.922650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 28/67] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:51 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:52.285127 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:52.285732 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:52.292630 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.293365 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.294304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.294731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.429479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:52.430162 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:52.432287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=12 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:52.440529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:52.442872 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.443496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.447980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.449056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.453496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-21c63942-17d7-49f4-b981-023d6b9593d1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.172455 May 27 03:23:52.454644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 40/68] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:52 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:52.458746 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=67 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:52.593308 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:52.600835 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2c465878-086b-4cc3-9918-6a1b0eca7055 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.175066 May 27 03:23:52.601417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 29/69] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:52 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:52.751857 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:52.752452 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:52.758608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.759071 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.759827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.760254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.879601 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:52.880519 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:52.888150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.888806 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.890695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.891235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.905920 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:52.913557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9112bcc9-d2c8-4eef-81f6-099769566ab7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.165727 May 27 03:23:52.914453 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 41/70] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:52 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:52.943388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:52.944088 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:52.950403 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.950924 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.951779 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:52.952263 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:52.957136 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:52.964749 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f793a3da-ed1d-40de-9015-f90ad01f6c1b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1246 microversion: 2.1 time: 0.088993 May 27 03:23:52.965565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 30/71] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:52 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:53.012980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:53.022063 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:53.023791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:53.025102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e8ebef06-e1b1-4d4b-9a03-bfc7a917e295 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1342 microversion: 2.20 time: 0.085753 May 27 03:23:53.025651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 42/72] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:52 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:53.471914 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:53.472699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:53.481604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.482236 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:53.483265 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.483836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:53.617231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:53.618119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:53.626755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.626970 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:53.629635 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.630351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:53.685920 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:53.696624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-34db16c5-5d2e-4517-9b7c-f3acc52c67b1 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.228936 May 27 03:23:53.705045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 31/73] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:53 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:53.776486 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:53.785245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0d73880f-179f-451a-a173-68e23814d478 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.171751 May 27 03:23:53.795429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 43/74] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:53 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:53.931178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:53.932096 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:53.941028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.941547 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:53.942530 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.942959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:53.982630 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:53.983231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:53.989477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.989985 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:53.990822 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:53.991315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.056076 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:54.064421 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-556737ab-b0bc-418f-9119-36be4d63c499 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1246 microversion: 2.1 time: 0.085834 May 27 03:23:54.072398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 44/75] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:53 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:54.078674 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.079524 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:54.087400 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:54.087906 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.089225 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:54.089823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.132422 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:54.140072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0767aa35-cf4a-421e-bc43-2571638a152f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.213376 May 27 03:23:54.141361 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 32/76] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:53 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:54.167477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:54.175663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:54.177307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:54.178338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b524cd74-1835-4706-b6c6-aa852af223d1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1342 microversion: 2.20 time: 0.104082 May 27 03:23:54.178900 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 45/77] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:54.376989 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-4cb7d271-678f-4883-9741-e52a7a9a5ad7 req-2202c6e3-beae-4c28-abfa-14fe625580bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0b7be0-94f6-463c-ae31-1fdb017d059a", "name": "network-vif-plugged", "status": "completed", "tag": "6d9acc3b-ba55-4e78-9bbb-cb5a5ce850ef"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:54.386443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-4cb7d271-678f-4883-9741-e52a7a9a5ad7 req-2202c6e3-beae-4c28-abfa-14fe625580bb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:54.386878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-4cb7d271-678f-4883-9741-e52a7a9a5ad7 req-2202c6e3-beae-4c28-abfa-14fe625580bb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.399447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-4cb7d271-678f-4883-9741-e52a7a9a5ad7 req-2202c6e3-beae-4c28-abfa-14fe625580bb service nova] Creating event network-vif-plugged:6d9acc3b-ba55-4e78-9bbb-cb5a5ce850ef for instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a on hv-cinder-82880 May 27 03:23:54.404449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-4cb7d271-678f-4883-9741-e52a7a9a5ad7 req-2202c6e3-beae-4c28-abfa-14fe625580bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032128 May 27 03:23:54.408250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 33/78] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:54.716068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.717431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:54.728045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:54.732844 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.733991 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:54.734603 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.804236 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:54.805163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:54.812314 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:54.812946 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.813921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:54.814803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:54.985331 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:54.994336 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-62761d2e-de30-4703-9818-b93fd3d622d0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.194494 May 27 03:23:55.004657 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 34/79] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:55.005107 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:55.016159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7679b80e-eedc-426f-abbe-295fb531be2f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.306175 May 27 03:23:55.017071 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 46/80] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:54 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:55.082090 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:55.083822 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:55.096258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:55.100034 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:55.101001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:55.101656 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:55.158155 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:55.158477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:55.165855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:55.166312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:55.167090 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:55.167529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:55.203983 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:55.211969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-32f7cf15-d8b0-40d6-9aad-460024935cfd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1238 microversion: 2.1 time: 0.133924 May 27 03:23:55.212815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 35/81] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:55 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:55.217754 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:55.218628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:55.225817 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:55.226561 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:55.230770 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:55.231245 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:55.337285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:55.351564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:55.353803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:55.355669 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a637e20c-fe2a-4a80-bc8f-cf4fb3de0dae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1352 microversion: 2.20 time: 0.141400 May 27 03:23:55.357072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 36/82] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:55 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:55.702487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:55.712865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4be06b51-6fe0-460a-85fe-e91a6ee65126 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.559117 May 27 03:23:55.714070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 47/83] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:55 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:55.934767 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-73e0c378-94df-4eb6-b5b2-0bcc966b048d req-34869b32-ed7f-4f34-870d-924c769e6f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a04444dd-f9dd-428f-b524-fba73fc83fe4", "tag": "bfbe9cb8-2655-4fd9-8904-baffc1034ee0"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:55.957295 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-73e0c378-94df-4eb6-b5b2-0bcc966b048d req-34869b32-ed7f-4f34-870d-924c769e6f4b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:55.965545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-73e0c378-94df-4eb6-b5b2-0bcc966b048d req-34869b32-ed7f-4f34-870d-924c769e6f4b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:55.997913 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-73e0c378-94df-4eb6-b5b2-0bcc966b048d req-34869b32-ed7f-4f34-870d-924c769e6f4b service nova] Creating event network-changed:bfbe9cb8-2655-4fd9-8904-baffc1034ee0 for instance a04444dd-f9dd-428f-b524-fba73fc83fe4 on hv-cinder-82880 May 27 03:23:56.004689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-73e0c378-94df-4eb6-b5b2-0bcc966b048d req-34869b32-ed7f-4f34-870d-924c769e6f4b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074624 May 27 03:23:56.012584 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:56.013734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:56.018857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 37/84] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:23:56.022579 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.023296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.024422 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.025216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.046904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:56.047626 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:56.067344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.071528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.072579 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.075193 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.447180 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:56.458052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9662b868-7852-4dd7-83a6-daacaa9bb525 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1315 microversion: 2.1 time: 0.424084 May 27 03:23:56.459221 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 38/85] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:56 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:56.472035 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:56.474747 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:56.483425 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cdf29895-cfe8-42a5-b313-3bec08b0100e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.475002 May 27 03:23:56.483764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:56.484542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:56.491326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 48/86] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:56 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:56.505447 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:56.506840 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.507423 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:56.512663 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.516006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.517029 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.520931 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.521415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.522295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.522689 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.737126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:56.749057 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:56.750737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:56.751940 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8038c706-68cf-4ccf-86d8-5d6279c9258c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1340 microversion: 2.20 time: 0.259075 May 27 03:23:56.752450 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 49/87] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:56 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1340 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:56.767678 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:56.772442 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:56.795508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.798339 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:56.800670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:56.801557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:57.109587 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:57.118183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8cd66309-7681-4428-8a4d-4b2e7d9f51bc tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.364598 May 27 03:23:57.118973 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 50/88] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:56 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:57.178167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:57.197850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8e6af149-ab7c-46f8-ac56-9790889edf14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1294 microversion: 2.1 time: 0.735841 May 27 03:23:57.199070 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 39/89] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:56 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1294 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:57.490303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:57.491446 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:57.505170 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:57.506015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:57.521145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:57.522609 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:57.525202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:57.525653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:57.529639 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:57.530205 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:57.531045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:57.531473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:57.815873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:57.825719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dd1794b8-0acc-4ca5-9018-66b6d46df5d2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.325784 May 27 03:23:57.834650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 40/90] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:57 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:57.843004 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:57.843987 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:57.850943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:57.851676 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:57.852510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:57.853158 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:57.861597 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:57.869720 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8dcf4d39-d5a6-4225-b446-e05de6bc9e98 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1501 microversion: 2.1 time: 0.397238 May 27 03:23:57.870438 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 51/91] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:57 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1501 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:58.109491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:58.121944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:58.124396 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:58.126461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-43f47c0b-4782-4808-95e4-c5490b2aaaae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.290585 May 27 03:23:58.127223 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 41/92] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:57 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:23:58.144192 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.145049 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:58.152155 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:23:58.154323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.155157 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.156160 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.156800 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.216550 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.217215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:58.224508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.225055 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.225832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.229417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.383666 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:58.394967 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fb142684-380b-4934-a664-d5d7f0e51d8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1300 microversion: 2.1 time: 0.183437 May 27 03:23:58.395683 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 42/93] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:58 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:58.654652 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-605bf000-2c7f-4b59-b2e0-19abe0ac4c64 req-45e7d8af-e7af-4f89-b3a6-772df71a8a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126a653e-c2f9-4fad-9401-b165bddb395d", "name": "network-vif-plugged", "status": "completed", "tag": "93f8d1e6-7ba3-465b-83b0-41aabb82cf05"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:58.669894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-605bf000-2c7f-4b59-b2e0-19abe0ac4c64 req-45e7d8af-e7af-4f89-b3a6-772df71a8a5a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.675870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-605bf000-2c7f-4b59-b2e0-19abe0ac4c64 req-45e7d8af-e7af-4f89-b3a6-772df71a8a5a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.703400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-605bf000-2c7f-4b59-b2e0-19abe0ac4c64 req-45e7d8af-e7af-4f89-b3a6-772df71a8a5a service nova] Creating event network-vif-plugged:93f8d1e6-7ba3-465b-83b0-41aabb82cf05 for instance 126a653e-c2f9-4fad-9401-b165bddb395d on hv-cinder-82880 May 27 03:23:58.727590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-605bf000-2c7f-4b59-b2e0-19abe0ac4c64 req-45e7d8af-e7af-4f89-b3a6-772df71a8a5a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076456 May 27 03:23:58.728465 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 43/94] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:58.833939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:58.844600 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9b2e6ae6-7a7e-4adb-b930-eb250a1280f8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.704627 May 27 03:23:58.846244 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:58.847161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:58.856884 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.859282 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:58.862589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 52/95] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:58 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:58.863266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:58.863948 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.028348 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-5536844e-3111-41c3-9a51-35c7aca2ada6 req-44c53e31-42cf-49d2-bab9-f5540d179af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54917ef-d32c-4303-99e3-75adc12f147e", "tag": "fe4197df-049a-453f-a110-e4a007e15f18"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:59.044628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5536844e-3111-41c3-9a51-35c7aca2ada6 req-44c53e31-42cf-49d2-bab9-f5540d179af9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.049323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5536844e-3111-41c3-9a51-35c7aca2ada6 req-44c53e31-42cf-49d2-bab9-f5540d179af9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.105084 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-5536844e-3111-41c3-9a51-35c7aca2ada6 req-44c53e31-42cf-49d2-bab9-f5540d179af9 service nova] Creating event network-changed:fe4197df-049a-453f-a110-e4a007e15f18 for instance b54917ef-d32c-4303-99e3-75adc12f147e on hv-cinder-82880 May 27 03:23:59.112245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-5536844e-3111-41c3-9a51-35c7aca2ada6 req-44c53e31-42cf-49d2-bab9-f5540d179af9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088099 May 27 03:23:59.112865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 53/96] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:23:59.145603 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.149279 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:59.150658 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:59.158036 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.159467 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4c64e9d2-c88a-4661-9b8c-e930ed8bb50b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.319410 May 27 03:23:59.160284 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.161009 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 44/97] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:58 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:23:59.166449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.167234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.415803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.417002 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:59.423387 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.423821 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.424753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.425224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.527567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:59.536111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33b8efd5-3792-42fa-9c9d-bb66e755c65b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1300 microversion: 2.1 time: 0.124645 May 27 03:23:59.536719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 45/98] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:23:59.543895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c2c36d60-b426-4a74-afda-671a91aa2ea9 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcadd503-7d96-42db-8117-7efb34834487"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:23:59.545353 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c2c36d60-b426-4a74-afda-671a91aa2ea9 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:59.556027 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2c36d60-b426-4a74-afda-671a91aa2ea9 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.557130 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2c36d60-b426-4a74-afda-671a91aa2ea9 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.558516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2c36d60-b426-4a74-afda-671a91aa2ea9 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.559124 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:59.559363 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2c36d60-b426-4a74-afda-671a91aa2ea9 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.570978 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:59.572856 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:23:59.574081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0a0d92cb-e16e-40df-a637-17f5ea5ef4a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.432924 May 27 03:23:59.574814 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 54/99] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:23:59.872023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:23:59.872749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:23:59.884557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.885272 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:23:59.886510 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:23:59.886510 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:00.619209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:00.672612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c2c36d60-b426-4a74-afda-671a91aa2ea9 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "POST /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.134117 May 27 03:24:00.674520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 46/100] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:23:59 2022] POST /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4/os-volume_attachments => generated 194 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:00.716433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:00.717619 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:00.737061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:00.737903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:00.741358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:00.742359 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:00.843384 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:00.856502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-093651c8-ef82-40d1-84b7-428fb5e41b66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.990261 May 27 03:24:00.860031 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 55/101] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:23:59 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:00.873878 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:00.875499 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:00.886280 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:00.886970 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:00.888137 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:00.889264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:01.026435 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:01.035297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3ae20a6d-5fa6-41e2-9f85-ec03d5721847 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.333910 May 27 03:24:01.036064 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 47/102] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:01.041822 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:01.042617 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:01.055178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:01.055970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:01.056817 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:01.057377 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:01.225636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:01.238613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:01.240630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:01.242074 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cb295a62-54e0-4c8b-a7fc-0a30dbd336e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.204913 May 27 03:24:01.242995 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 48/103] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:01 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:01.386735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:01.394837 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8981aaf5-5685-49e3-bf08-2fa946366e5f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.531780 May 27 03:24:01.395468 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 56/104] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:00 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:01.877669 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:01.879702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:01.895641 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=10 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:01.901294 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=12 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:01.934191 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:01.934413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:01.935741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:01.936385 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.052836 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:02.054268 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:02.057578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=28 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:02.064845 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.066049 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.067253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.067920 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.190365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:02.213959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-50cb1eec-cbdd-4363-a5f6-f569a6daa44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.340079 May 27 03:24:02.215435 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 49/105] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:01 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:02.260259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:02.261426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:02.272889 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.274087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.277362 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.278249 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.441555 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:02.456885 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-06ea2d99-b1c0-4d5a-b9ce-dbb954c6aacd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.408048 May 27 03:24:02.460761 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 57/106] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:02 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:02.474584 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:02.475529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:02.492017 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.493216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.494168 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.496091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.616352 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:02.628795 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:02.635122 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:02.638028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f8cc2142-1172-49c8-9583-7ef4a095cd93 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.380502 May 27 03:24:02.652144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 50/107] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:02 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:02.670239 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-dfcaf0a1-7267-4683-b2dd-ab56e5f10425 req-55b1c713-b2a4-444b-b408-bd5760be7b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04444dd-f9dd-428f-b524-fba73fc83fe4", "name": "network-vif-plugged", "status": "completed", "tag": "bfbe9cb8-2655-4fd9-8904-baffc1034ee0"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:02.696055 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dfcaf0a1-7267-4683-b2dd-ab56e5f10425 req-55b1c713-b2a4-444b-b408-bd5760be7b20 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.696809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dfcaf0a1-7267-4683-b2dd-ab56e5f10425 req-55b1c713-b2a4-444b-b408-bd5760be7b20 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.714142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-dfcaf0a1-7267-4683-b2dd-ab56e5f10425 req-55b1c713-b2a4-444b-b408-bd5760be7b20 service nova] Creating event network-vif-plugged:bfbe9cb8-2655-4fd9-8904-baffc1034ee0 for instance a04444dd-f9dd-428f-b524-fba73fc83fe4 on hv-cinder-82880 May 27 03:24:02.738508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-dfcaf0a1-7267-4683-b2dd-ab56e5f10425 req-55b1c713-b2a4-444b-b408-bd5760be7b20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071878 May 27 03:24:02.744391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 51/108] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:02.751670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-b1c99a96-1253-45ad-977c-0ac9d8cab470 req-c26ddc85-07d6-44d1-8c73-cb06b49373e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d00e4700-28c6-4440-83e4-c3d1a86a75c7", "tag": "1ad404ad-b415-4130-81fb-67637fa7ba8a"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:02.766528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-b1c99a96-1253-45ad-977c-0ac9d8cab470 req-c26ddc85-07d6-44d1-8c73-cb06b49373e8 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:02.767381 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-b1c99a96-1253-45ad-977c-0ac9d8cab470 req-c26ddc85-07d6-44d1-8c73-cb06b49373e8 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:02.784269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-b1c99a96-1253-45ad-977c-0ac9d8cab470 req-c26ddc85-07d6-44d1-8c73-cb06b49373e8 service nova] Creating event network-changed:1ad404ad-b415-4130-81fb-67637fa7ba8a for instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 on hv-cinder-82880 May 27 03:24:02.789404 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-b1c99a96-1253-45ad-977c-0ac9d8cab470 req-c26ddc85-07d6-44d1-8c73-cb06b49373e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043240 May 27 03:24:02.790220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 52/109] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:02.889928 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:02.911149 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1a79b69f-4238-493d-8ff9-592b2e0e95b4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.445207 May 27 03:24:02.912125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 58/110] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:02 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:03.233487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:03.234979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:03.241815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.242270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.243046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.243597 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.427902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:03.440297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b710f61c-9c52-4a00-8823-ae03af116a6c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1322 microversion: 2.1 time: 0.211369 May 27 03:24:03.441642 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 53/111] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:03 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:03.482274 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:03.482897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:03.489555 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.490180 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.491398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.491552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.654860 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:03.655493 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:03.661517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.663459 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.667806 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.668271 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.906324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:03.919132 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:03.922021 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:03.925240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-77bfc525-b777-44cc-954a-64b0596d15a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.274218 May 27 03:24:03.926292 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 54/112] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:03 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:03.932163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:03.933060 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:03.940581 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.941140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:03.942294 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:03.943221 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:04.050769 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:04.080701 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-80cad032-ad05-4a35-a3af-f9a2b33a5f61 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.600153 May 27 03:24:04.082768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 59/113] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:03 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:04.147183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:04.161874 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aba8efb3-9935-4f0d-ab2f-131970a2961e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.233904 May 27 03:24:04.163993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 55/114] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:03 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:04.461318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:04.462179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:04.469139 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:04.469605 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:04.470437 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:04.470888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:04.947898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:04.949038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:04.976766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:04.977289 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:04.978092 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:04.978530 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.050927 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:05.061490 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a30c3afc-f8ff-4cac-9d6a-10632cb43445 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1517 microversion: 2.1 time: 0.605383 May 27 03:24:05.064295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 60/115] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:04 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1517 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:05.096413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:05.103158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:05.119058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.121029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.121926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.124808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.217758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'flavor' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:24:05.379500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-54216023-34bf-43a6-83be-1997a53ad0a0 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d/action" status: 200 len: 32 microversion: 2.1 time: 0.294717 May 27 03:24:05.381540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 61/116] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:24:05 2022] POST /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:24:05.393562 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:05.395126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:05.402426 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.403106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.404149 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.404675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.426023 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:05.439145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:05.466368 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:05.468800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dd1fcd79-4ab2-4e6c-a4e5-97f36edc8e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.528535 May 27 03:24:05.482520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 56/117] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:04 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:05.488496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:05.494463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:05.507184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.507730 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.508805 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.509274 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.567336 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:05.576027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-652968d3-810d-4ea0-9a95-9f1f3a3a139c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.193053 May 27 03:24:05.576793 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 62/118] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:05 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:05.582797 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:05.583582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:05.592609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.593120 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.593896 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:05.594365 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:05.735990 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:05.743732 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1cc52616-93a4-4afa-a246-bbc5c586b432 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.165721 May 27 03:24:05.744346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 63/119] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:05 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:06.030236 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:06.045012 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-72687f78-ebbc-4e4a-ae15-acb64d3fd98f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.559909 May 27 03:24:06.045805 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 57/120] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:05 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:06.490913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:06.492413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:06.507942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:06.509003 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:06.509860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:06.510369 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:06.537360 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:06.593797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:06.594593 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:06.616066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:06.616869 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:06.622062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:06.623734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:06.724312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:06.743663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:06.745318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:06.746764 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-72813b0f-66e1-4ff3-8ba5-6bd094e0f500 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.261628 May 27 03:24:06.748183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 64/121] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:06 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:06.763760 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:06.764418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:06.772998 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:06.773622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:06.774513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:06.774955 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:06.921135 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:06.929914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-386e89dd-9ce5-46c2-9c0a-831735411a11 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.170954 May 27 03:24:06.930554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 65/122] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:06 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:06.944253 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:06.952501 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f98e3559-204c-4030-9809-64b1171327ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1363 microversion: 2.1 time: 0.362853 May 27 03:24:06.953035 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 58/123] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:06 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:07.062898 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:07.063512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:07.066599 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:07.077040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:07.077791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:07.080192 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:07.081023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:07.448202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:07.458757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6d311643-f6f5-4dfb-8e77-807a65ea2264 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.399914 May 27 03:24:07.459537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 66/124] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:07 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:07.766659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:07.767268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:07.774161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:07.774849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:07.776033 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:07.776800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:07.950564 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:07.951834 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:07.958272 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:07.958770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:07.961028 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:07.961028 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:08.011389 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:08.025222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:08.027830 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:08.029230 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-255da00c-599c-47d8-bd85-5cc0263b5529 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.266914 May 27 03:24:08.030763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 59/125] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:07 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:08.036327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:08.037267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:08.043810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:08.045012 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:08.050443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:08.053407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:08.111076 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:08.119755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-53181b11-0289-42a8-b979-517b8fd94bae tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.172651 May 27 03:24:08.120755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 67/126] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:07 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:08.463340 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:08.473376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-09558973-8cbf-4f4e-8c13-47734de2acc9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1548 microversion: 2.1 time: 0.441400 May 27 03:24:08.474045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 60/127] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:08 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1548 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:08.475981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:08.476767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:08.485007 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:08.488317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:08.491085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:08.491723 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:08.492603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ff8e9cb9-0734-4295-9b0c-ba141676a261 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:08.493426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ff8e9cb9-0734-4295-9b0c-ba141676a261 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:08.500475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff8e9cb9-0734-4295-9b0c-ba141676a261 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:08.501124 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff8e9cb9-0734-4295-9b0c-ba141676a261 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:08.502034 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff8e9cb9-0734-4295-9b0c-ba141676a261 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:08.502470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff8e9cb9-0734-4295-9b0c-ba141676a261 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:08.659087 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:08.675319 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-10303caa-6a2f-4e08-9fed-7caf277c350a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.199017 May 27 03:24:08.677032 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 68/128] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:08 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:08.700572 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ff8e9cb9-0734-4295-9b0c-ba141676a261 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211783 May 27 03:24:08.701250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 61/129] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:24:08 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:24:09.048170 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:09.048837 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:09.059537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.060157 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.062551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.063301 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.138020 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:09.138779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:09.147085 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.161785 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.162644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.163090 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.483908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:09.493204 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-701f3b08-3a22-489e-850a-e930ae7e13ca tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.359745 May 27 03:24:09.494457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 62/130] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:09 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:09.561050 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:09.575069 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:09.576598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:09.577944 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-96cf2154-20e0-49a8-8b26-32d60f6c5df2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.534078 May 27 03:24:09.579145 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 69/131] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:09 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:09.694780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:09.695660 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:09.703426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.704189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.705198 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:09.705840 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:09.890912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:09.909909 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c54189a0-ebf0-4a89-888b-1c026c9272cd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.218201 May 27 03:24:09.915601 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 63/132] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:09 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:10.416264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-16e02cbd-37da-45f9-aa62-30f5242cd1ba req-fbb95ecb-81a7-454e-81cc-471526eafeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a04444dd-f9dd-428f-b524-fba73fc83fe4", "tag": "bfbe9cb8-2655-4fd9-8904-baffc1034ee0"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:10.433169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-16e02cbd-37da-45f9-aa62-30f5242cd1ba req-fbb95ecb-81a7-454e-81cc-471526eafeb9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.433621 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-16e02cbd-37da-45f9-aa62-30f5242cd1ba req-fbb95ecb-81a7-454e-81cc-471526eafeb9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:10.452557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-16e02cbd-37da-45f9-aa62-30f5242cd1ba req-fbb95ecb-81a7-454e-81cc-471526eafeb9 service nova] Creating event network-changed:bfbe9cb8-2655-4fd9-8904-baffc1034ee0 for instance a04444dd-f9dd-428f-b524-fba73fc83fe4 on hv-cinder-82880 May 27 03:24:10.458854 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-16e02cbd-37da-45f9-aa62-30f5242cd1ba req-fbb95ecb-81a7-454e-81cc-471526eafeb9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046037 May 27 03:24:10.459769 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 70/133] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:10.511482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:10.512258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:10.519375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.519883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:10.520671 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.521222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:10.596504 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:10.597393 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:10.604875 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.605552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:10.611281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.611948 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:10.689935 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:10.693168 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:10.703038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1591e875-621d-4233-80f8-2ca9a2ff72a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.196152 May 27 03:24:10.704570 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 64/134] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:10 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:10.798094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:10.807658 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:10.809387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:10.810617 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bd8dcd0a-8544-46b7-a18c-32ab589f0e50 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.218619 May 27 03:24:10.811257 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 71/135] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:10 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:10.935560 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:10.937349 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:10.961975 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.963032 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:10.965818 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:10.966483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.230776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:11.239783 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c8ca1ce7-d943-4c40-a0a9-639a5411ec8b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.315643 May 27 03:24:11.242670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 65/136] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:10 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:11.722543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:11.723338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:11.733824 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:11.734487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.735406 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:11.736280 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.757256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-95326c88-ffb3-4881-b52c-b8a70326cc24 req-11288efa-a3f4-4268-8fd4-550df1a30421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54917ef-d32c-4303-99e3-75adc12f147e", "name": "network-vif-plugged", "status": "completed", "tag": "fe4197df-049a-453f-a110-e4a007e15f18"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:11.774318 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-95326c88-ffb3-4881-b52c-b8a70326cc24 req-11288efa-a3f4-4268-8fd4-550df1a30421 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:11.775188 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-95326c88-ffb3-4881-b52c-b8a70326cc24 req-11288efa-a3f4-4268-8fd4-550df1a30421 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.789747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-95326c88-ffb3-4881-b52c-b8a70326cc24 req-11288efa-a3f4-4268-8fd4-550df1a30421 service nova] Creating event network-vif-plugged:fe4197df-049a-453f-a110-e4a007e15f18 for instance b54917ef-d32c-4303-99e3-75adc12f147e on hv-cinder-82880 May 27 03:24:11.797749 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-95326c88-ffb3-4881-b52c-b8a70326cc24 req-11288efa-a3f4-4268-8fd4-550df1a30421 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045835 May 27 03:24:11.801706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 66/137] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:11.832363 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:11.834422 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:11.849819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:11.851588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.853426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:11.855773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:11.946916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:11.964020 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-10ed5ec4-12d0-4203-9f74-667d60732bb8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.242405 May 27 03:24:11.965307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 72/138] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:11 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:12.260041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:12.260493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:12.280165 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:12.280616 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:12.285234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:12.287061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:12.312722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.321457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.334480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.336132 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d91b4775-85e8-4da5-9083-70e17771b07e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.511961 May 27 03:24:12.337279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 67/139] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:11 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:12.534411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:12.551886 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-57e498a2-9b72-46bd-9d15-1626e9dad5fb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.294598 May 27 03:24:12.552537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 73/140] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:12 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:12.983542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:12.985086 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:12.998159 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:12.998910 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.000036 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.000658 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.360570 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:13.361351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:13.368178 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.368622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.369656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.370150 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.672702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:13.682837 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a662e962-d0af-4ba8-9bf7-400705115b64 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.703914 May 27 03:24:13.693571 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 68/141] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:12 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:13.705254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:13.705871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:13.717199 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.717655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.718439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:13.718878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:13.968204 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:13.978296 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ea3f19e8-58f1-41fb-9c3c-e582f44fe897 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.282125 May 27 03:24:13.979127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 69/142] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:13 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:14.003910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.021773 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.024222 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:14.025497 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-27f1b4f7-56d0-44ee-91fd-45a350de9230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.674865 May 27 03:24:14.028010 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 74/143] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:13 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:14.709165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:14.709781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:14.724646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:14.725402 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:14.728180 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:14.728813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:14.996210 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:14.997742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:15.033881 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.040990 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.045966 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.046422 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.166287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.176481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f4c6ec48-3895-4dd4-aa91-ede6e5f9a366 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.479916 May 27 03:24:15.177284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 70/144] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:14 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:15.183121 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:15.184130 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:15.195855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.196708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.199097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.199980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.441396 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.450235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.451649 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.456651 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c0412db9-5ee0-4700-88af-0f6695f5e26a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.278241 May 27 03:24:15.475577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 71/145] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:15 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:15.489241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:15.492475 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:15.494000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:15.510415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-00f66105-7da0-46eb-8eea-04ba22378fc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.516759 May 27 03:24:15.511576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 75/146] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:14 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:15.512730 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.518035 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.519123 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:15.520393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:15.586092 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:24:16.045696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fea3b8a2-c6ec-46b3-a4c8-e5851c965603 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 204 len: 0 microversion: 2.1 time: 0.567706 May 27 03:24:16.046777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 72/147] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:24:15 2022] DELETE /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:24:16.059847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:16.059847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:16.080309 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.082016 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.082967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.084134 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.193851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:16.195039 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:16.205459 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.211043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.213578 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.215701 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.525263 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:16.558356 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-aa20070b-b9f0-409a-8d0d-3b9bd988eb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1553 microversion: 2.1 time: 0.506787 May 27 03:24:16.565198 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 76/148] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:16 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1553 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:16.572188 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:16.573070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:16.584541 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.585556 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.586527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.587107 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.917739 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:16.928737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c37b6512-9778-4b84-951c-51902d386159 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.739360 May 27 03:24:16.941120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 73/149] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:16 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:16.948858 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:16.949764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:16.960580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.962216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:16.964016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:16.964680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.029706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.051451 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.053396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.057119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-506a013b-979a-45e0-b72b-4bff06bb1cff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.490173 May 27 03:24:17.058075 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 77/150] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:16 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:24:17.107191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-099b5085-0a1b-4432-86d3-bdbee9d1b2b8 req-21163da5-74b2-426d-a56d-77ef1ef4843b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d00e4700-28c6-4440-83e4-c3d1a86a75c7", "name": "network-vif-plugged", "status": "completed", "tag": "1ad404ad-b415-4130-81fb-67637fa7ba8a"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:17.127684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-099b5085-0a1b-4432-86d3-bdbee9d1b2b8 req-21163da5-74b2-426d-a56d-77ef1ef4843b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.128380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-099b5085-0a1b-4432-86d3-bdbee9d1b2b8 req-21163da5-74b2-426d-a56d-77ef1ef4843b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.159258 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-099b5085-0a1b-4432-86d3-bdbee9d1b2b8 req-21163da5-74b2-426d-a56d-77ef1ef4843b service nova] Creating event network-vif-plugged:1ad404ad-b415-4130-81fb-67637fa7ba8a for instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 on hv-cinder-82880 May 27 03:24:17.171429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-099b5085-0a1b-4432-86d3-bdbee9d1b2b8 req-21163da5-74b2-426d-a56d-77ef1ef4843b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071305 May 27 03:24:17.172746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 78/151] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:24:17.201191 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.212876 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d77e44b4-868b-4cbe-b228-63254aaa4f66 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.270221 May 27 03:24:17.217134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 74/152] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:16 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:17.588811 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:17.589657 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:17.602473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.602927 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.603726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.604165 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.826381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:17.844543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0ec0cd0f-db9b-4f54-b70e-fd5ccf06e60b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1553 microversion: 2.1 time: 0.264941 May 27 03:24:17.845508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 79/153] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:17 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:17.947786 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:17.948740 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:17.959096 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.959850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:17.960906 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:17.961694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.076123 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:18.076763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:18.095701 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.096607 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.098143 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.098955 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.286321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.311968 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-28e79cba-7a1b-4b74-9337-3bba23226b4d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.368516 May 27 03:24:18.313067 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 75/154] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:17 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:18.319946 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:18.320935 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:18.326103 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:18.331033 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.333107 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.334333 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.335605 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.348013 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.361132 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.365255 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.374783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-385f05d2-242c-4e42-bc11-27e82e998d0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1408 microversion: 2.20 time: 0.300558 May 27 03:24:18.386183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 80/155] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:18 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:18.796643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:18.805588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c82b8f99-a769-42a7-b235-489bde786c43 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.490536 May 27 03:24:18.808583 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 76/156] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:18 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:18.862486 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:18.863099 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:18.875208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.875690 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:18.876492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:18.876930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.133672 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.148485 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-82cd1c49-3927-4c50-9b08-984e97613a55 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1553 microversion: 2.1 time: 0.286170 May 27 03:24:19.156944 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 81/157] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:18 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:19.331712 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:19.332516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:19.343682 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.344152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.346464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.346930 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.393554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:19.394855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:19.407173 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.408862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.410015 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.410470 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.415563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:19.548177 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.556408 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-915fecaa-1d16-4760-9b02-198e4a208c2f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.228490 May 27 03:24:19.557032 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 77/158] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:19 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:19.589313 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.599260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.601165 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:19.602351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e7034fce-455c-4ac7-ba00-a45e8641a7ae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1599 microversion: 2.20 time: 0.213355 May 27 03:24:19.602902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 82/159] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:24:19 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:24:19.621416 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-63635b11-c3d0-4e5d-92ca-99ad7a8bdcfe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:19.622261 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-63635b11-c3d0-4e5d-92ca-99ad7a8bdcfe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:19.628687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63635b11-c3d0-4e5d-92ca-99ad7a8bdcfe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.629171 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63635b11-c3d0-4e5d-92ca-99ad7a8bdcfe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.629946 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63635b11-c3d0-4e5d-92ca-99ad7a8bdcfe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.630381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63635b11-c3d0-4e5d-92ca-99ad7a8bdcfe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.725168 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-63635b11-c3d0-4e5d-92ca-99ad7a8bdcfe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107601 May 27 03:24:19.726190 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 83/160] 10.222.0.50 () {60 vars in 1315 bytes} [Fri May 27 03:24:19 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:24:19.782750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f7f61866-d0f1-4e10-9de6-78f345c484d1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Action: 'create', calling method: .version_select at 0x7f5e74439af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-940256736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE67Y/kPntLIiogcg13fMibG/mBxlqiWk+xPXDCYnN18rXWGoxHWCtD4/VVu7eYsz5HVcEws+5VFxcx0ZmVLhfyO06myHZzX9oK1zXwHw/WGjkjbB1yjt74qdhG/0GZQkw=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:19.816728 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-f7f61866-d0f1-4e10-9de6-78f345c484d1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for project d5bef1b49d424299864523887eb72b3c. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:24:19.824146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-f7f61866-d0f1-4e10-9de6-78f345c484d1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for user 01be6ea7136e45aead352146193f05ed and project d5bef1b49d424299864523887eb72b3c. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:24:19.827610 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:19.828620 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:19.838826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.853876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.856889 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:19.858411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:19.919823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f7f61866-d0f1-4e10-9de6-78f345c484d1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.361416 May 27 03:24:19.920903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 78/161] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:24:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:20.174539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:20.175153 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:20.187019 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.187847 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.188398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.188916 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.295432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:20.305600 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-43b93105-9158-4c15-811b-390c6cc0a6df tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.483161 May 27 03:24:20.306885 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 84/162] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:19 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:20.576995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:20.579142 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:20.589639 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.591148 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:20.592837 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:20.593618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:21.091100 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.102116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-697bb62e-ff10-4f35-b7f8-84037b54f0cb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.532119 May 27 03:24:21.103080 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 85/163] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:20 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:21.118186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.139626 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ce547393-11c9-4ed6-a8dc-9a0bd0714881 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1553 microversion: 2.1 time: 0.969047 May 27 03:24:21.140591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 79/164] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:20 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1553 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:21.325156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:21.325771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:21.334751 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:21.338657 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:21.340153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:21.340601 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:21.932159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:21.941435 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fa88f4f5-9871-483c-9a6f-062444088795 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1367 microversion: 2.1 time: 0.622207 May 27 03:24:21.943895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 86/165] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:21 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1367 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:22.127577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:22.135502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:22.148309 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.149556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.150677 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.151377 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.164396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:22.165554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:22.176253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.176728 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.177487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.186616 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.311703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:22.327559 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-449cd833-6421-48c3-9fad-27f148a68ad8 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1511 microversion: 2.1 time: 0.169557 May 27 03:24:22.337632 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 87/166] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:22 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:22.343432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-533b64ac-2759-408b-aded-e859ac5813da req-c2a2b098-2b0f-472b-a2d3-6788517c9449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddacdbc-778d-43a4-9781-bc1bfec238e4", "name": "network-vif-deleted", "tag": "80ce9414-7ad7-4080-9680-4d84a0a632b6"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:22.356821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-533b64ac-2759-408b-aded-e859ac5813da req-c2a2b098-2b0f-472b-a2d3-6788517c9449 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.358507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-533b64ac-2759-408b-aded-e859ac5813da req-c2a2b098-2b0f-472b-a2d3-6788517c9449 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.383794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-533b64ac-2759-408b-aded-e859ac5813da req-c2a2b098-2b0f-472b-a2d3-6788517c9449 service nova] Creating event network-vif-deleted:80ce9414-7ad7-4080-9680-4d84a0a632b6 for instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 on hv-cinder-82880 May 27 03:24:22.407046 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-533b64ac-2759-408b-aded-e859ac5813da req-c2a2b098-2b0f-472b-a2d3-6788517c9449 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050635 May 27 03:24:22.409934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 88/167] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:22.490237 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-83ba0d5f-e2fd-4cb7-88ae-b43bb4fc9b08 req-3f95e04e-8329-4c43-9be3-25ca030d0f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54917ef-d32c-4303-99e3-75adc12f147e", "tag": "fe4197df-049a-453f-a110-e4a007e15f18"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:22.512934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-83ba0d5f-e2fd-4cb7-88ae-b43bb4fc9b08 req-3f95e04e-8329-4c43-9be3-25ca030d0f16 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.515473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-83ba0d5f-e2fd-4cb7-88ae-b43bb4fc9b08 req-3f95e04e-8329-4c43-9be3-25ca030d0f16 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.517928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:22.526084 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-89a3313c-70ec-45e6-a21b-5d23f91b0945 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.406228 May 27 03:24:22.526677 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 80/168] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:22 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:22.576598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-83ba0d5f-e2fd-4cb7-88ae-b43bb4fc9b08 req-3f95e04e-8329-4c43-9be3-25ca030d0f16 service nova] Creating event network-changed:fe4197df-049a-453f-a110-e4a007e15f18 for instance b54917ef-d32c-4303-99e3-75adc12f147e on hv-cinder-82880 May 27 03:24:22.613679 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-83ba0d5f-e2fd-4cb7-88ae-b43bb4fc9b08 req-3f95e04e-8329-4c43-9be3-25ca030d0f16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126044 May 27 03:24:22.615309 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 89/169] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:24:22.960565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:22.961108 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:22.972166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.972614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:22.977219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:22.977673 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.034715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:23.346381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:23.347056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:23.355998 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.362869 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.377309 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-245e9c48-3e6a-4894-8800-189c6282f11b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1557 microversion: 2.1 time: 0.419222 May 27 03:24:23.379635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 81/170] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:22 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1557 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:23.384317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.388294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.391913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.406133 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9b480128-8919-465f-a951-42fb09ba85ae tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:23.410129 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9b480128-8919-465f-a951-42fb09ba85ae tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:23.436738 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b480128-8919-465f-a951-42fb09ba85ae tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.439259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b480128-8919-465f-a951-42fb09ba85ae tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.441866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b480128-8919-465f-a951-42fb09ba85ae tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.448895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b480128-8919-465f-a951-42fb09ba85ae tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.647146 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b22fa493ae04d5fac13b94cff154eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a3ae93f6ab44af93b0538061809b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.661227 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c9cdf667-a451-418d-b4f4-73710bb6741e tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 200 len: 1346 microversion: 2.1 time: 0.320128 May 27 03:24:23.665732 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 90/171] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:23 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 1346 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:23.713253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:23.713975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:23.741805 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.742350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.743178 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:23.743608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:23.767280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9b480128-8919-465f-a951-42fb09ba85ae tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.372673 May 27 03:24:23.768204 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 82/172] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:24:23 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-interface => generated 284 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:23.965435 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:23.974430 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-332f19af-7b71-42d8-ab4d-4de7fc1ae271 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.307206 May 27 03:24:23.975534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 91/173] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:23 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:24.690915 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:24.694005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:24.711802 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.712556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.713539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.714133 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.732240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] HTTP exception thrown: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Request method failure captured: May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 HTTP/1.1 May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQfr7F8rp1VYh9SGmuggunybctg2RHkUzkMfnH9YVTh6hAqDQf1Bt5MAoy2xNGeYwogHY3py3o7cG1V-TcSnu19G8R-SSwsZuOesg9P6KVcjt1Kfv1DwTMZ0-VznliXCYejz08311cbIAXShgU-DUQZOzSl1uowFECQhv6wowpgRuE May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:24:24.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 1b22fa493ae04d5fac13b94cff154eee May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:24.757006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '0ddacdbc-778d-43a4-9781-bc1bfec238e4'} May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:24:24.757852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:24.759207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:24:24.763638 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Returning 404 to user: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:24:24.765043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f783c1d8-0f01-44d7-936f-ec5316e11b13 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 404 len: 111 microversion: 2.1 time: 0.085238 May 27 03:24:24.765789 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 83/174] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:24 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:24:24.953543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:24.955074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:24.966458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.967219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.969279 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:24.972789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:24.991362 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:24.992290 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:25.003841 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.004453 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.006212 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.006993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.035056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] HTTP exception thrown: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Request method failure captured: May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4/os-volume_attachments HTTP/1.1 May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQfr7F8rp1VYh9SGmuggunybctg2RHkUzkMfnH9YVTh6hAqDQf1Bt5MAoy2xNGeYwogHY3py3o7cG1V-TcSnu19G8R-SSwsZuOesg9P6KVcjt1Kfv1DwTMZ0-VznliXCYejz08311cbIAXShgU-DUQZOzSl1uowFECQhv6wowpgRuE May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:24:25.043439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 1b22fa493ae04d5fac13b94cff154eee May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:25.044731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'server_id': '0ddacdbc-778d-43a4-9781-bc1bfec238e4'} May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:24:25.045408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:25.046507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:25.055036 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Returning 404 to user: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:24:25.056341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8befa5e3-f36f-474e-b09d-e07f53ab9a0b tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.106761 May 27 03:24:25.057638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 92/175] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:24:24 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4/os-volume_attachments => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:24:25.480469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:25.488349 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0be333b7-c4fe-447f-a0cf-e73d43fa226f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.501306 May 27 03:24:25.498031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 84/176] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:24 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:25.892749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-e0712f04-312e-4ab4-b002-c41e63cd66bd req-abad3579-c11e-4ee5-a50f-874263046908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d00e4700-28c6-4440-83e4-c3d1a86a75c7", "tag": "1ad404ad-b415-4130-81fb-67637fa7ba8a"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:25.900547 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e0712f04-312e-4ab4-b002-c41e63cd66bd req-abad3579-c11e-4ee5-a50f-874263046908 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:25.901018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e0712f04-312e-4ab4-b002-c41e63cd66bd req-abad3579-c11e-4ee5-a50f-874263046908 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:25.914166 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-e0712f04-312e-4ab4-b002-c41e63cd66bd req-abad3579-c11e-4ee5-a50f-874263046908 service nova] Creating event network-changed:1ad404ad-b415-4130-81fb-67637fa7ba8a for instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 on hv-cinder-82880 May 27 03:24:25.919821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-e0712f04-312e-4ab4-b002-c41e63cd66bd req-abad3579-c11e-4ee5-a50f-874263046908 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032333 May 27 03:24:25.923406 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 93/177] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:26.524156 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:26.524766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:26.540301 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.540761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.541580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.542026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.546350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:26.547735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:26.557153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.558094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.559288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.559937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.582534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] HTTP exception thrown: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Request method failure captured: May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 HTTP/1.1 May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQfr7F8rp1VYh9SGmuggunybctg2RHkUzkMfnH9YVTh6hAqDQf1Bt5MAoy2xNGeYwogHY3py3o7cG1V-TcSnu19G8R-SSwsZuOesg9P6KVcjt1Kfv1DwTMZ0-VznliXCYejz08311cbIAXShgU-DUQZOzSl1uowFECQhv6wowpgRuE May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:24:26.585916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 1b22fa493ae04d5fac13b94cff154eee May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.587300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '0ddacdbc-778d-43a4-9781-bc1bfec238e4'} May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:24:26.587915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.589091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.591749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Returning 404 to user: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:24:26.592806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-428b021a-30bf-4fe5-96af-fa192437712f tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 404 len: 111 microversion: 2.1 time: 0.051133 May 27 03:24:26.593578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 94/178] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:24:26 2022] DELETE /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:24:26.606944 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:26.607563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] [instance: 0ddacdbc-778d-43a4-9781-bc1bfec238e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:26.636191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.636685 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.652547 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:26.653443 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:26.695558 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] HTTP exception thrown: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Request method failure captured: May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 HTTP/1.1 May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQfr7F8rp1VYh9SGmuggunybctg2RHkUzkMfnH9YVTh6hAqDQf1Bt5MAoy2xNGeYwogHY3py3o7cG1V-TcSnu19G8R-SSwsZuOesg9P6KVcjt1Kfv1DwTMZ0-VznliXCYejz08311cbIAXShgU-DUQZOzSl1uowFECQhv6wowpgRuE May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:24:26.697130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a0a3ae93f6ab44af93b0538061809b98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: a0a3ae93f6ab44af93b0538061809b98 May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-DeleteServersTestJSON-2102923163 May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 1b22fa493ae04d5fac13b94cff154eee May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-DeleteServersTestJSON-2102923163-project May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.698281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '0ddacdbc-778d-43a4-9781-bc1bfec238e4'} May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:24:26.698910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. May 27 03:24:26.699897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:24:26.705391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] Returning 404 to user: Instance 0ddacdbc-778d-43a4-9781-bc1bfec238e4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:24:26.709551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-94379081-1b2e-4e5d-bde3-d0441528fb97 tempest-DeleteServersTestJSON-2102923163 tempest-DeleteServersTestJSON-2102923163-project] 10.222.0.50 "GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4" status: 404 len: 111 microversion: 2.1 time: 0.110429 May 27 03:24:26.710826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 95/179] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:26 2022] GET /compute/v2.1/servers/0ddacdbc-778d-43a4-9781-bc1bfec238e4 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:24:27.041066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:27.050240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-af52bd17-6fe1-41d0-b43b-f80197250c8a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.533484 May 27 03:24:27.050834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 85/180] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:26 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:28.069190 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:28.071137 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:28.077935 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:28.078439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:28.079328 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:28.079940 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:28.324427 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:28.342152 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7028651f-826a-47ed-a864-337fec8f8df3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.278080 May 27 03:24:28.360710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 96/181] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:28 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:29.362378 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:29.362993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:29.376297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.377371 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.379408 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:29.380384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:29.573871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:29.582593 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-07a9c821-c5c5-4e05-b548-8ed1f03ef021 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.225497 May 27 03:24:29.583162 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 86/182] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:29 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:30.466738 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bec05355-bd6a-4090-b900-34939dbf95a8 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e74297550>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:30.520052 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bec05355-bd6a-4090-b900-34939dbf95a8 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5bc96b5e-057f-4603-b480-9f5c682f4e38" status: 200 len: 351 microversion: 2.1 time: 0.057460 May 27 03:24:30.520653 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 97/183] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:24:30 2022] GET /compute/v2.1/os-volumes/5bc96b5e-057f-4603-b480-9f5c682f4e38 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:30.604571 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:30.605194 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:30.612327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:30.614776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.615228 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.616153 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:30.617697 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:30.786430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:30.797141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-474a1423-b36a-4ea0-b60c-9d617b30a0f2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.199857 May 27 03:24:30.798513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 87/184] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:30 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:31.816121 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:31.816849 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:31.824001 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.824450 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.825312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:31.825706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:31.966662 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:31.977810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f5829844-b3ee-49d0-8885-74d99e0e0b9b tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e743e4040>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:31.982387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0841dbba-6443-4cbc-b09c-fec40676015c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.170583 May 27 03:24:31.983004 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 98/185] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:31 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:24:32.029801 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f5829844-b3ee-49d0-8885-74d99e0e0b9b tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4dcf6ec5-e928-4b89-a202-a712c9ead9de" status: 200 len: 350 microversion: 2.1 time: 0.056232 May 27 03:24:32.030394 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 88/186] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:24:31 2022] GET /compute/v2.1/os-volumes/4dcf6ec5-e928-4b89-a202-a712c9ead9de => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:33.001760 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.002341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:33.010257 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:33.010707 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.011477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:33.011909 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:33.152562 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:33.161197 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-215322a1-25fe-44ee-8e74-1c7e9e3799f7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.164404 May 27 03:24:33.161752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 99/187] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:32 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:33.429090 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9c7e50b2-226f-4e69-a61c-d2bc02c00949 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e742ffe50>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.486605 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9c7e50b2-226f-4e69-a61c-d2bc02c00949 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ba9953e6-4ea9-4592-9833-f0a9eab97f77" status: 200 len: 351 microversion: 2.1 time: 0.062486 May 27 03:24:33.487187 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 89/188] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/os-volumes/ba9953e6-4ea9-4592-9833-f0a9eab97f77 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:33.499196 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-57597d50-2c42-446d-aaa1-c325a9ac9357 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e743691f0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.583728 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-57597d50-2c42-446d-aaa1-c325a9ac9357 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088839 May 27 03:24:33.584341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 100/189] 10.222.0.50 () {58 vars in 1133 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:33.596849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c779275b-7c20-4ad1-80fb-0a08ed9b9d96 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e742ffaf0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.686508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c779275b-7c20-4ad1-80fb-0a08ed9b9d96 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093424 May 27 03:24:33.687105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 90/190] 10.222.0.50 () {58 vars in 1148 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:33.700763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1cc9fc88-a37e-47d5-a1b0-05f8e1fc1309 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e742c79d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.784640 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1cc9fc88-a37e-47d5-a1b0-05f8e1fc1309 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088338 May 27 03:24:33.785545 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 101/191] 10.222.0.50 () {58 vars in 1133 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:33.797889 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f5dfd814-cc02-47a6-b9b4-720be036ef4b tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e742ffd30>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.881397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f5dfd814-cc02-47a6-b9b4-720be036ef4b tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087316 May 27 03:24:33.881978 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 91/192] 10.222.0.50 () {58 vars in 1166 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:33.894179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d87e3e56-ad8c-4d1c-bf9c-cf92d1c8b9db tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e742c9940>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:33.979968 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d87e3e56-ad8c-4d1c-bf9c-cf92d1c8b9db tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089549 May 27 03:24:33.980579 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 102/193] 10.222.0.50 () {58 vars in 1169 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:33.993447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-09dd1b45-b7c6-416e-8f58-8826ec88e882 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e743e41f0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.075081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-09dd1b45-b7c6-416e-8f58-8826ec88e882 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086198 May 27 03:24:34.075665 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 92/194] 10.222.0.50 () {58 vars in 1154 bytes} [Fri May 27 03:24:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:34.087637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e4fae5ad-a842-48b8-9eae-1f37185cfa92 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e742c9ca0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.172320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e4fae5ad-a842-48b8-9eae-1f37185cfa92 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088523 May 27 03:24:34.173037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 103/195] 10.222.0.50 () {58 vars in 1187 bytes} [Fri May 27 03:24:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:24:34.178972 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.179730 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:34.184986 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ab25561d-3dde-469e-b38c-0618950ca8b3 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] Calling method '.version_select at 0x7f5e74578940>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:34.187834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.188284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.189087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:34.189520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:34.275380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ab25561d-3dde-469e-b38c-0618950ca8b3 tempest-VolumesTestJSON-206303072 tempest-VolumesTestJSON-206303072-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094573 May 27 03:24:34.276033 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 104/196] 10.222.0.50 () {58 vars in 1154 bytes} [Fri May 27 03:24:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:34.330874 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:34.345183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bc1250a1-942f-4d5a-8d04-ee0e6ad05e3e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.169708 May 27 03:24:34.346239 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 93/197] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:34 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:35.363271 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:35.363859 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:35.371952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:35.372423 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:35.373204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:35.373642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:35.508028 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:35.516536 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-132b84e3-8e38-44dc-ad06-b3391ae3b8d3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.157615 May 27 03:24:35.517129 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 105/198] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:35 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:36.534187 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:36.534827 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:36.542164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.542762 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.543501 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:36.543934 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:36.694547 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:36.704262 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-961bbbc2-5a19-4611-b548-59f3dfa9c3e4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.174304 May 27 03:24:36.704849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 94/199] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:36 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:37.724412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:37.724412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:37.724987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=68 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:37.732391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:37.733082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.733856 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:37.734338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:37.886873 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:37.895749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-81e52e9a-9f36-460e-adce-ec60da05b75b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.177898 May 27 03:24:37.896316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 106/200] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:37 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:38.917658 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:38.918459 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:38.926627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.927378 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:38.928160 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:38.928767 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:39.066445 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:39.074334 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c7014ae4-0192-4390-b28c-759a4600d93d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.162987 May 27 03:24:39.074935 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 95/201] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:38 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:40.094045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:40.094706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:40.101196 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:40.101652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:40.102435 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:40.102872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:40.251942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:40.259396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fb7cbe2f-2dbd-4a7f-8c67-8a1a51b94fb7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.171294 May 27 03:24:40.260018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 107/202] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:40 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:41.280332 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:41.281088 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:41.287870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.288358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.289286 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:41.289742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:41.443011 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:41.450458 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ccec1d07-486c-4061-85ed-cc16fe995f6a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.174685 May 27 03:24:41.451055 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 96/203] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:41 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:42.467572 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:42.468767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:42.475240 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.475663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:42.476418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:42.476838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:42.619634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:42.627731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-18c3806a-d690-407b-81c2-4fd0e3ce6417 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.164082 May 27 03:24:42.628267 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 108/204] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:42 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:43.645566 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:43.646171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:43.652921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:43.653406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:43.654167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:43.654605 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:43.810143 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:43.818566 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a774ad44-528f-46b7-b73c-38c1fcdd5e84 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1523 microversion: 2.1 time: 0.176981 May 27 03:24:43.819155 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 97/205] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:43 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:44.836585 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:44.837323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:44.843762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.844521 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:44.845330 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:44.845769 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:44.848295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:44.981010 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:44.989240 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-abb1d421-f3b2-4da9-ab32-21224263fa21 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1503 microversion: 2.1 time: 0.156746 May 27 03:24:44.989821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 109/206] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:44 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:45.005590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:45.006199 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:45.013164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:45.013743 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:45.014711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:45.015145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:45.158578 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:45.166663 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7ac0916c-eba2-4560-9cee-61d9b120930a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1516 microversion: 2.1 time: 0.164925 May 27 03:24:45.167341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 98/207] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:45 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:49.752804 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:24:49.756068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:49.762166 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.762587 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.763349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.763785 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.793501 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'flavor' on Instance uuid 8c0b7be0-94f6-463c-ae31-1fdb017d059a {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:24:49.890056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dfebdc66-0aa1-4264-a5fc-37099b90a2e9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a/action" status: 200 len: 32 microversion: 2.1 time: 0.141219 May 27 03:24:49.890621 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 110/208] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:24:49 2022] POST /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:24:49.901162 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:49.901914 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:49.908656 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:49.910463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.911099 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:49.912360 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:49.928027 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:50.194481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:50.204010 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-df665896-6efe-464f-88de-5434fd30ca66 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.307544 May 27 03:24:50.204570 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 99/209] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:49 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:51.222965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:51.223810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:51.231646 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.232434 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.233442 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:51.234074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:51.434712 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:51.443297 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b13040c6-0ac3-4a19-8d19-5a04885e2e06 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.225324 May 27 03:24:51.444224 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 111/210] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:51 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:52.460792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:52.461501 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:52.468115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:52.468560 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:52.469366 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:52.470054 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:52.633293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:52.647286 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-24e54b39-0f03-49cd-9dd0-1389cbc46676 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.190314 May 27 03:24:52.656675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 100/211] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:52 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:53.664563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:53.665294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:53.674315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:53.674768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:53.675541 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:53.675976 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:53.819672 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:53.827544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3854ba27-bb7f-447c-b8b0-991bf06d22c6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.167171 May 27 03:24:53.828091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 112/212] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:53 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:54.848524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:54.849695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:54.861018 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.861795 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.863181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:54.863904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:54.870019 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=82 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:24:55.004692 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:55.016250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-42432cff-f37d-492f-968c-aad9284085fe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.174240 May 27 03:24:55.016980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 101/213] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:54 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:56.038171 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:56.039140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:56.046186 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:56.046638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:56.047417 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:56.047850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:56.183236 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:56.194003 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d3860d14-9ce9-472a-ae67-d2f1016baa55 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.162447 May 27 03:24:56.194980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 113/214] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:56 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:57.212174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:57.212936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:57.219868 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:57.220491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:57.221600 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:57.222240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:57.363431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:57.371415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8bc2f851-8966-4d1c-97bd-434d34db9ac4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.163767 May 27 03:24:57.371985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 102/215] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:57 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:58.387848 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:58.388425 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:58.397128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:58.397128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:58.397128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:58.397501 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:58.536350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:58.544569 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-88b12fc1-34b5-4b49-8b90-996362f651a9 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.160696 May 27 03:24:58.545176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 114/216] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:58 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:24:59.562310 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:24:59.562919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:24:59.569696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:59.570146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:59.571590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:24:59.572055 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:24:59.711056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:24:59.719538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-866a6a1b-a752-4be5-8260-86d83af00660 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.161005 May 27 03:24:59.720140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 103/217] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:24:59 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:00.737433 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:00.738207 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:00.744448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.744937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:00.745779 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:00.746208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:00.886151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:00.894146 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d9ea1ba1-53ea-4d3f-9ad4-3d6a5585d6a7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.160773 May 27 03:25:00.894679 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 115/218] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:00 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:01.912592 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:01.913450 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:01.920551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:01.921034 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:01.921798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:01.922483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:02.064215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:02.075021 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9b1fd25a-fd8b-4693-9446-d50a52a19daa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.166842 May 27 03:25:02.075780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 104/219] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:01 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:03.092917 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:03.093554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:03.099884 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:03.100340 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:03.101151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:03.101593 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:03.237713 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:03.246146 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-252c5e7f-7648-4ebc-b7d3-f1beae721225 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.157048 May 27 03:25:03.246870 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 116/220] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:03 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:04.264152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:04.264761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:04.271521 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:04.271970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:04.272723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:04.273356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:04.419080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:04.426703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ca99fa46-f388-4ff1-a020-2998178846b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.167117 May 27 03:25:04.427281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 105/221] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:04 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:05.445571 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:05.446367 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:05.454500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:05.454938 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:05.455707 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:05.456106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:05.648523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:05.665851 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-badac64c-4cb9-418e-bdc0-f62a774eb85e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.225288 May 27 03:25:05.666618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 117/222] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:05 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:06.685087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:06.686496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:06.695144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:06.697358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:06.698608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:06.699140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:06.833189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:06.841089 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9609e8d0-78cb-441c-befe-769b7632a05e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.160486 May 27 03:25:06.841669 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 106/223] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:06 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:07.675226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6728abd6-ba3e-47f9-8688-6e24a43e41c8 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:07.676041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6728abd6-ba3e-47f9-8688-6e24a43e41c8 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:07.682193 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6728abd6-ba3e-47f9-8688-6e24a43e41c8 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.682667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6728abd6-ba3e-47f9-8688-6e24a43e41c8 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:07.683428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6728abd6-ba3e-47f9-8688-6e24a43e41c8 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.683855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6728abd6-ba3e-47f9-8688-6e24a43e41c8 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:07.712273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6728abd6-ba3e-47f9-8688-6e24a43e41c8 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/ips" status: 200 len: 145 microversion: 2.1 time: 0.041316 May 27 03:25:07.712864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 118/224] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:25:07 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:07.862318 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:07.862955 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:07.871287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.871738 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:07.872490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:07.872920 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:08.217285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:08.225127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3b622468-63de-4751-bf9b-bd1a73d314aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.368955 May 27 03:25:08.225748 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 107/225] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:07 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:09.247376 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:09.248457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:09.251654 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=26 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:09.258870 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:09.259301 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:09.260027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:09.260448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:09.399244 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:09.407494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fceec41d-9dca-4247-9685-e53b50cb30b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.166771 May 27 03:25:09.408066 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 119/226] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:09 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:10.425392 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:10.425974 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:10.432994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:10.433482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:10.434252 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:10.434694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:10.570387 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:10.578464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-813ae53b-8731-4b69-b79c-1e802183d0fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.157110 May 27 03:25:10.579454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 108/227] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:10 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:11.599827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:11.600383 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:11.609942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.609942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.609942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:11.609942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:11.751508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:11.759740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1a6b6290-697a-47c3-bdda-6e34329ba27c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.166121 May 27 03:25:11.760349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 120/228] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:11 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:12.777251 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:12.777955 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:12.785436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:12.786102 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:12.786938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:12.787439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:12.932483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:12.940236 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-42e4513e-5e9f-4f18-8f76-6ed81b53f7dd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.166924 May 27 03:25:12.940794 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 109/229] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:12 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:13.268485 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e5c98e49-8025-4189-847f-a64d460d13ba tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4748d6c4-ca85-4607-948e-980fbd2c26f4"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:13.269657 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e5c98e49-8025-4189-847f-a64d460d13ba tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:13.276485 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5c98e49-8025-4189-847f-a64d460d13ba tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:13.276922 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5c98e49-8025-4189-847f-a64d460d13ba tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:13.277713 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5c98e49-8025-4189-847f-a64d460d13ba tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:13.278139 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5c98e49-8025-4189-847f-a64d460d13ba tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:13.597476 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e5c98e49-8025-4189-847f-a64d460d13ba tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335661 May 27 03:25:13.598052 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 121/230] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:25:13 2022] POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:13.957230 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:13.957825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:13.964725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:13.965237 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:13.966009 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:13.966444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:14.105878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:14.113309 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-49bb291f-71ff-46c5-a02f-f598416ed4a8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.160084 May 27 03:25:14.113859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 110/231] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:13 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:15.130692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:15.131504 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:15.139906 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:15.140354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:15.141145 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:15.141612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:15.144333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:15.309042 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:15.316684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e2bb5152-a9f9-4a46-a0f1-a7393195489c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.190310 May 27 03:25:15.317261 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 122/232] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:15 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:16.337945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:16.338503 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:16.346845 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:16.347375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:16.348417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:16.348931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:16.486585 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:16.494722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c3c7fd49-b202-4ab3-a4a2-d9a350621ddb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.163002 May 27 03:25:16.495532 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 111/233] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:16 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:17.212342 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-094d817b-5574-4501-b528-316996298807 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:17.212937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-094d817b-5574-4501-b528-316996298807 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:17.221209 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-094d817b-5574-4501-b528-316996298807 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:17.221686 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-094d817b-5574-4501-b528-316996298807 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:17.222502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-094d817b-5574-4501-b528-316996298807 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:17.222962 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-094d817b-5574-4501-b528-316996298807 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:17.247749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-094d817b-5574-4501-b528-316996298807 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/ips" status: 200 len: 151 microversion: 2.20 time: 0.039529 May 27 03:25:17.248316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 123/234] 10.222.0.50 () {60 vars in 1288 bytes} [Fri May 27 03:25:17 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:25:17.514273 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:17.515097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:17.522216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:17.522866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:17.523793 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:17.524381 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:17.568275 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-43905691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-940256736", "security_groups": [{"name": "tempest-secgroup-smoke-1104536221"}], "block_device_mapping_v2": [{"uuid": "d87d0a9c-3296-4457-ac47-9a6c1f204a60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79e2e930-0200-4ceb-a2bb-a93bbb04e0f6"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:17.722957 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:17.736093 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d9dfae9b-6452-4aac-96fa-4ff94fb311fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.227206 May 27 03:25:17.738484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 112/235] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:17 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:17.757233 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] validate_networks() for [('79e2e930-0200-4ceb-a2bb-a93bbb04e0f6', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:25:18.397116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:25:18.397719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:25:18.397974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:25:18.398377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:25:18.398808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:25:18.407931 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:18.408368 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:18.409263 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:18.409692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:18.426222 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for project d5bef1b49d424299864523887eb72b3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:25:18.430538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for user 01be6ea7136e45aead352146193f05ed and project d5bef1b49d424299864523887eb72b3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:25:18.489619 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:25:18.492039 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d87d0a9c-3296-4457-ac47-9a6c1f204a60',volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:25:18.634770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c12004e5-befd-46bb-bc4e-051a06a696ab tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.070440 May 27 03:25:18.635431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 124/236] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:25:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:25:18.647376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-be56264c-858b-45b6-b645-e37c8764c738 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:18.647912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-be56264c-858b-45b6-b645-e37c8764c738 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:18.706443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-be56264c-858b-45b6-b645-e37c8764c738 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:18.718773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-be56264c-858b-45b6-b645-e37c8764c738 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1092 microversion: 2.1 time: 0.075391 May 27 03:25:18.719365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 113/237] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:18 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1092 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:18.760235 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:18.760374 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:18.768191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:18.768627 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:18.769861 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:18.770301 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:18.919159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:18.929153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a5bd79bf-13c2-486d-9124-4d812eea2e49 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.173194 May 27 03:25:18.929948 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 125/238] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:18 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:19.736354 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:19.736997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:19.746016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:19.746633 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:19.747651 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:19.748094 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:19.816570 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:19.824933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8226b76a-4fd4-490a-ba48-b353f44815af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1142 microversion: 2.1 time: 0.092891 May 27 03:25:19.825588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 114/239] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:19 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1142 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:19.946570 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:19.947655 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:19.954742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:19.955195 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:19.955958 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:19.956392 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.224090 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:20.234105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-116d2e61-844c-4ddf-b8b8-3a4b4a89d827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.291068 May 27 03:25:20.234982 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 126/240] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:19 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:20.381230 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:20.381230 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:20.381230 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=34 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:20.381230 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.381604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.381921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.382871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.408391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lazy-loading 'flavor' on Instance uuid b54917ef-d32c-4303-99e3-75adc12f147e {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:25:20.746752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-82ca8d1e-e563-4c85-9b3c-273d8e605cb6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/action" status: 202 len: 0 microversion: 2.20 time: 0.378999 May 27 03:25:20.747793 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 115/241] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 03:25:20 2022] POST /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:25:20.756611 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:20.757254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:20.764402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.764766 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.765552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.765983 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.843689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:20.844387 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:20.851044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.851497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.852263 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:20.852699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:20.906473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:20.914879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:20.918751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:20.921959 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:20.922919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:20.923563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e20256c2-0b3c-40af-8826-8e997e36bb40 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.171229 May 27 03:25:20.926778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 127/242] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:20 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:20.929344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d71b77f3-035b-48b2-ae1d-b8a9abf8cb31 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1190 microversion: 2.1 time: 0.090210 May 27 03:25:20.929909 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 116/243] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:20 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1190 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:21.259057 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:21.260046 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:21.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.271726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:21.273000 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.273758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:21.424256 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:21.436126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dcfeadf1-195c-4b71-9800-e0e570e1e182 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.184999 May 27 03:25:21.436925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 128/244] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:21 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:21.942954 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:21.943581 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:21.946895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:21.947549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:21.951496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.951964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:21.952734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.953196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:21.954970 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.955419 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:21.956197 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:21.956664 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:22.018352 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:22.026048 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-14a0f92b-6982-4b53-bd8d-caa8d7082c87 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1190 microversion: 2.1 time: 0.083069 May 27 03:25:22.026619 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 129/245] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:21 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1190 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:22.086618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:22.096119 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:22.097674 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:22.098840 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5cf1c7b4-7619-414e-8f26-26ac8888ce5d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.160298 May 27 03:25:22.099395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 117/246] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:21 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:22.462361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:22.463358 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:22.471834 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:22.472270 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:22.473076 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:22.473504 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:22.605122 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:22.614641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c4152b49-dc77-44db-8297-ae3bb9da7bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.158704 May 27 03:25:22.615246 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 130/247] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:22 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:23.042984 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:23.043601 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:23.050481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.050931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.051693 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.052124 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.117359 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:23.117967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:23.125017 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.125017 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.125803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.126239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.128664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:23.136996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8f039fd2-79ed-41c9-9439-0d6a017d9dbf tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1190 microversion: 2.1 time: 0.097775 May 27 03:25:23.140097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 118/248] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:23 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1190 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:23.266322 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:23.275068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:23.277497 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:23.279047 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e89421d-60d2-497b-93f8-c277c6bc81e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.165719 May 27 03:25:23.279611 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 131/249] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:23 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:23.637478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:23.639163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:23.648210 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.648824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.650003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:23.650608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:23.799264 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:23.807450 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-98a8cf1e-e271-4c90-b6f1-0c0761f7a554 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.177554 May 27 03:25:23.808066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 119/250] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:23 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:24.155254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:24.155780 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:24.163015 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.163504 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:24.164270 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.164706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:24.238358 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:24.249618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f2955c68-4928-4713-859a-842d16f558e2 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1198 microversion: 2.1 time: 0.098561 May 27 03:25:24.250193 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 132/251] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:24 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:24.300524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:24.301212 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:24.308178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.308620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:24.309515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.310032 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:24.455511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:24.463560 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:24.465172 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:24.467694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-31b74b2d-a256-4de9-a07e-bd7b240bc850 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.171147 May 27 03:25:24.468225 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 120/252] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:24 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:24.831803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:24.832512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:24.838971 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.839524 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:24.840314 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:24.841472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.017393 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:25.026952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a3aa702f-f5cc-4408-93ee-bf8b8262ec18 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1502 microversion: 2.1 time: 0.207141 May 27 03:25:25.027609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 133/253] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:24 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1502 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:25.045641 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e8f98f3-f21a-4c4a-abe6-d78c51c84ab4"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:25.046755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:25.052849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.053263 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.054368 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.054798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.083144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] HTTP exception thrown: Cannot 'attach_volume' instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a while it is in vm_state rescued May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Request method failure captured: May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: POST /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a/os-volume_attachments HTTP/1.1 May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 74 May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQvkgP6dheA1HISWpdWxeiMUoVKTOpvwrpfLG-ikSRwPw6Oq6pJowRRCtPYOjlAZkPx6l1XfuLMN1XJmMcVOfiQL4cYiJx5ijWcOp_OLv9lVLF8Xf_ooNsu_C-fVamGPpIZtMPA-zLDtioWYSFm6PMhCcJi0NjCRk6CyajVkFIWqV0 May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:25:25.085275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 468a46d55bd342739b9cd78bcd3a77fc May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {"volumeAttachment": {"volumeId": "2e8f98f3-f21a-4c4a-abe6-d78c51c84ab4"}} May 27 03:25:25.087365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Cannot 'attach_volume' instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a while it is in vm_state rescued May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'server_id': '8c0b7be0-94f6-463c-ae31-1fdb017d059a', 'body': {'volumeAttachment': {'volumeId': '2e8f98f3-f21a-4c4a-abe6-d78c51c84ab4'}}} May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:25:25.092549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a while it is in vm_state rescued May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:25:25.093969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:25:25.095258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:25:25.095258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:25:25.095258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a while it is in vm_state rescued May 27 03:25:25.095258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:25:25.095258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Returning 409 to user: Cannot 'attach_volume' instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a while it is in vm_state rescued {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:25:25.095258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-39a2f969-bbed-406e-957c-795f4f195cff tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046084 May 27 03:25:25.095258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 121/254] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:25:25 2022] POST /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 03:25:25.097245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c0684733-4979-4b2f-b40e-898b6a077372 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:25.097799 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c0684733-4979-4b2f-b40e-898b6a077372 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:25.109508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0684733-4979-4b2f-b40e-898b6a077372 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.109952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0684733-4979-4b2f-b40e-898b6a077372 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.110715 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0684733-4979-4b2f-b40e-898b6a077372 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.111138 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0684733-4979-4b2f-b40e-898b6a077372 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.182081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c0684733-4979-4b2f-b40e-898b6a077372 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a/action" status: 202 len: 0 microversion: 2.1 time: 0.088609 May 27 03:25:25.182774 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 134/255] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:25:25 2022] POST /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:25:25.190879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:25.191515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:25.197557 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.197946 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.198691 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.199124 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.268923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:25.269997 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:25.277234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.277685 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.278609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.279002 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.338218 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:25.347692 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1582333b-fc42-4264-95e0-7ec3603b96df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1510 microversion: 2.1 time: 0.160630 May 27 03:25:25.348268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 122/256] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:25 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:25.353095 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:25.363646 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-399fff55-986d-43e4-b25c-e9b5958f3d75 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1208 microversion: 2.1 time: 0.099065 May 27 03:25:25.364219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 135/257] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:25 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1208 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:25.486768 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:25.487373 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:25.493902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.494357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.495349 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:25.495777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:25.633654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:25.642396 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:25.644034 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:25.645339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-472d11df-a11d-4ddf-8443-19e76c09ab2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.162791 May 27 03:25:25.645910 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 123/258] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:25 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:26.366892 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:26.367496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:26.378958 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.380486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:26.381134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:26.388008 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.389359 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.390413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.391515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.394644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.399175 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.405687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.481302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:26.489184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8bf3cc26-f9a9-4111-9168-21c866e7d592 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1208 microversion: 2.1 time: 0.112376 May 27 03:25:26.489974 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 124/259] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:26 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1208 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:26.662008 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:26.663742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:26.664345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:26.672438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.673127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.674310 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.674893 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.675226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e9908463-0ead-4b56-a5e0-b4fdc3525835 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1510 microversion: 2.1 time: 0.313960 May 27 03:25:26.677274 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 136/260] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:26 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:26.698969 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5f7dd43a-3835-4d77-84d3-df05028aebe6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:26.706244 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5f7dd43a-3835-4d77-84d3-df05028aebe6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.706839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5f7dd43a-3835-4d77-84d3-df05028aebe6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.779307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5f7dd43a-3835-4d77-84d3-df05028aebe6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Going to try to stop instance {{(pid=117767) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 03:25:26.827916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:26.846622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5f7dd43a-3835-4d77-84d3-df05028aebe6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action" status: 202 len: 0 microversion: 2.1 time: 0.153583 May 27 03:25:26.848059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 137/261] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:25:26 2022] POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:25:26.856881 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:26.857749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:26.865180 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.865762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.866653 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:26.867220 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:26.920986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:26.937192 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:26.939204 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:26.941121 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cbc18b65-9f38-4e82-8004-acefa5d23535 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.281127 May 27 03:25:26.942271 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 125/262] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:26 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:27.072995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:27.082108 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-eb3217d3-b5e7-49fe-b9cd-b36e1422c883 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.228674 May 27 03:25:27.083029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 138/263] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:26 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:27.507681 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:27.508467 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:27.516987 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.517600 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.518581 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.519101 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.695226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:27.695844 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:27.703354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.704022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.704623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.705134 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.783752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:27.792538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bbf66f99-fca5-4617-a5cb-f70783cb6ce1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1276 microversion: 2.1 time: 0.289155 May 27 03:25:27.793745 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 126/264] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:27 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:27.798747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-be73f103-6fa2-42b1-b3e4-bfde42c03f54 req-6277eb24-c920-4cab-b781-97980a908478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f03d50-8598-4db5-b3fd-ee77a878c5e4", "tag": "af8e6fc6-1227-49b2-a57c-d9ab051c9fe9"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:27.814799 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-be73f103-6fa2-42b1-b3e4-bfde42c03f54 req-6277eb24-c920-4cab-b781-97980a908478 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.816394 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-be73f103-6fa2-42b1-b3e4-bfde42c03f54 req-6277eb24-c920-4cab-b781-97980a908478 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.829534 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-be73f103-6fa2-42b1-b3e4-bfde42c03f54 req-6277eb24-c920-4cab-b781-97980a908478 service nova] Creating event network-changed:af8e6fc6-1227-49b2-a57c-d9ab051c9fe9 for instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 on hv-cinder-82880 May 27 03:25:27.839978 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-be73f103-6fa2-42b1-b3e4-bfde42c03f54 req-6277eb24-c920-4cab-b781-97980a908478 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044569 May 27 03:25:27.842116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 127/265] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:27.871420 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:27.881152 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e8a81793-5fa1-4f10-a76a-0fc979d9e9b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1510 microversion: 2.1 time: 0.189702 May 27 03:25:27.881813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 139/266] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:27 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:27.961809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:27.962506 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:27.970206 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.970656 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:27.971457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:27.971891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.100765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:28.101398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:28.118411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.119115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.120110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.120700 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.149749 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:28.158080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:28.159871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:28.161252 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8f91ab3b-73ac-4747-9c72-fc664b85b456 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.203898 May 27 03:25:28.162120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 128/267] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:27 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:28.276641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:28.285473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9afcc6de-909e-4a3f-9f89-f52fedd19c42 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.189142 May 27 03:25:28.286490 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 140/268] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:28 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:28.812066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:28.813126 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:28.815717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:28.821586 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.821964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.822742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.823175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.902409 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:28.903473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:28.908577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:28.909812 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:28.915531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.915979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.916756 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:28.917373 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:28.984537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:28.993355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e62468ab-c958-47d5-9aa1-1b11f40df12e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.186826 May 27 03:25:28.997411 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 129/269] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:28 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:29.095621 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:29.104836 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d147023b-47ce-4da4-a2be-0431b9eadd8c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1510 microversion: 2.1 time: 0.209452 May 27 03:25:29.105635 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 141/270] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:28 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:29.182038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:29.183369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:29.191398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:29.191924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:29.192881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:29.194258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:29.306721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:29.307326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:29.322541 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:29.323411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:29.325886 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:29.326637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:29.404403 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:29.414302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:29.417833 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:29.418493 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cae485af-7dc1-414f-8005-d63ac7ab4c5b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.242177 May 27 03:25:29.419084 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 130/271] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:29 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:29.556288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:29.564583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-65e23f06-f38f-44b7-a3f0-7dc11b51f4a7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.262874 May 27 03:25:29.565551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 142/272] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:29 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:30.014807 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:30.015651 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:30.022312 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.022766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.023540 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.023974 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.125736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:30.126340 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:30.134713 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.135449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.137105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.138752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.261670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:30.277986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e3e96dbf-1800-49ac-8589-7285fda94fe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.267130 May 27 03:25:30.278861 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 131/273] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:30 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:30.294388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:30.304897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b46510b2-71c9-46c1-9d29-22159869894a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1510 microversion: 2.1 time: 0.184370 May 27 03:25:30.305597 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 143/274] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:30 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:30.441142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:30.441883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:30.449183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.450461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.451802 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.452848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.583958 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:30.584762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:30.596838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.597428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.599385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:30.601617 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:30.630767 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:30.644505 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:30.650246 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:30.651678 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2bba9610-a2c5-4672-bbb0-ee27a134f74c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.215380 May 27 03:25:30.652758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 132/275] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:30 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:30.842787 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:30.851247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fb0ba23c-bc4e-493a-b463-bd7b95bef7a4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.272716 May 27 03:25:30.852174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 144/276] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:30 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:31.295183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:31.296564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:31.305879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.306643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.307813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.308459 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.322170 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:31.323736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:31.335392 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.336251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.337935 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.341883 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.544906 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:31.554425 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a48e18d4-7834-4783-9cd6-30bab6abc6e3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1516 microversion: 2.1 time: 0.235493 May 27 03:25:31.555723 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 145/277] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:31 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:31.562614 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2bb13dd1-b4ce-4136-99b4-edcd253ed00c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:31.563691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2bb13dd1-b4ce-4136-99b4-edcd253ed00c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:31.570596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2bb13dd1-b4ce-4136-99b4-edcd253ed00c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.571453 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2bb13dd1-b4ce-4136-99b4-edcd253ed00c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.572242 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2bb13dd1-b4ce-4136-99b4-edcd253ed00c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.572678 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2bb13dd1-b4ce-4136-99b4-edcd253ed00c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.605391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2bb13dd1-b4ce-4136-99b4-edcd253ed00c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/ips" status: 200 len: 149 microversion: 2.1 time: 0.048357 May 27 03:25:31.606733 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 146/278] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:25:31 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:31.671288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:31.671594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:31.684798 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.686081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.687359 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.687952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.935637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:31.944888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:31.946686 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:31.947929 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c74c7ccb-d5db-4ff6-a193-8a9f660f2773 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.281774 May 27 03:25:31.958794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 147/279] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:31 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:31.975548 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:31.976161 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:31.984838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.985307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:31.986296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:31.986806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:32.024713 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:32.049843 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fa42938d-56e9-48cb-908a-0ea350bad15d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.752224 May 27 03:25:32.062573 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 133/280] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:31 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:32.265755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:32.287721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-da596b40-79f6-403d-b698-70944ccbcea0 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.327725 May 27 03:25:32.288428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 148/281] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:31 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:32.966724 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:32.967472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:32.973702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:32.974141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:32.974903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:32.975333 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:32.991682 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:33.083403 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:33.086719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:33.098642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:33.099952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:33.101576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:33.102026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:33.118971 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:33.130654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:33.132265 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:33.133469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-319fddcc-bf19-4726-a368-00353d987e71 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.171149 May 27 03:25:33.134960 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 134/282] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:32 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:33.181276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8b898054-1f70-4f42-bf6a-ecccb438fd46 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'create', calling method: .version_select at 0x7f5e741df1f0>, body: {"keypair": {"name": "tempest-keypair-1984984206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWnnJnHYpAaATQo1tC9jxncI2feZp5Ff7HGb873E8eGZ0lHK5Dpj3VR7jmeRHFOEjS+JTtxl8kPXhJuCd0jJFnykKNigaTFPNeJoSXAAFGcCLGShrsHI4wW/JnDSifyHA=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:33.197464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8b898054-1f70-4f42-bf6a-ecccb438fd46 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for project 6db8193dcee944008c7b41889bfa67a3. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:25:33.202258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8b898054-1f70-4f42-bf6a-ecccb438fd46 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for user 468a46d55bd342739b9cd78bcd3a77fc and project 6db8193dcee944008c7b41889bfa67a3. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:25:33.240061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8b898054-1f70-4f42-bf6a-ecccb438fd46 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062392 May 27 03:25:33.246821 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 135/283] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:25:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:25:33.284160 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:33.292884 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c37bf517-04e7-41be-a1cf-42d8f79402af tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.216586 May 27 03:25:33.294304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 149/284] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:33 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:33.309524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:33.310209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:33.317025 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:33.317488 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:33.319935 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:33.320384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:33.511127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:33.520545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ed6a2f07-c3ec-437b-8dde-7c94b484f41a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.217498 May 27 03:25:33.521699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 136/285] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:33 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:34.044280 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1379591911", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "networks": [{"uuid": "d552a4c8-1cfd-43a0-b4ee-dbad181ed1bf"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:34.101481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] validate_networks() for [('d552a4c8-1cfd-43a0-b4ee-dbad181ed1bf', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:25:34.154228 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:34.154829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:34.161712 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.162157 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.162919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.163346 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.370729 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:34.379801 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:34.381733 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:34.383030 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e650d36d-f729-405a-b8f0-b7c2a6efad1b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.232922 May 27 03:25:34.384032 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 137/286] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:34 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:34.395473 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:34.396171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:34.413871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.414321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.415099 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.415530 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.489194 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:25:34.489700 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:25:34.490226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:25:34.490686 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:25:34.491156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:25:34.500905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.501680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.502561 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.503054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.521403 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Getting quotas for project 4052d211d2a346d8be95d6ac7761defb. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:25:34.525565 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Getting quotas for user f0fbd32e5751496e8eaaf3bd03d8f833 and project 4052d211d2a346d8be95d6ac7761defb. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:25:34.537429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:25:34.539698 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:25:34.586885 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9292f768-5420-44b0-8d61-408a1fe3052d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546615 May 27 03:25:34.587721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 150/287] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:25:34.593469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a701ca29-4a42-4700-a977-b56cbefd8d96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db775cf2-4493-42ae-b434-4c732475e8af"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:34.594862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a701ca29-4a42-4700-a977-b56cbefd8d96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:34.601991 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a701ca29-4a42-4700-a977-b56cbefd8d96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.602434 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a701ca29-4a42-4700-a977-b56cbefd8d96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.603265 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a701ca29-4a42-4700-a977-b56cbefd8d96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.603698 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a701ca29-4a42-4700-a977-b56cbefd8d96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.642878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:34.656828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-80c4e664-7cb7-4a0c-8f35-88d9db633521 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.270883 May 27 03:25:34.657553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 138/288] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:34 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:34.666640 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:34.667340 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:34.676238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.676719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.677664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:34.678235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:34.919981 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:34.941650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ceeff558-36ea-467c-a2fc-11ad00d18321 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.277903 May 27 03:25:34.943179 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 139/289] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:34 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:34.951474 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-264d7041-433a-4d84-b738-b80559e5e424 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:34.952443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-264d7041-433a-4d84-b738-b80559e5e424 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:35.025316 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-264d7041-433a-4d84-b738-b80559e5e424 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:35.034220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-264d7041-433a-4d84-b738-b80559e5e424 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1219 microversion: 2.1 time: 0.089752 May 27 03:25:35.035104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 140/290] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:34 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:35.040449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-614102191", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee2ac450-e56e-4c1d-8d15-c8bfd50e2024"}], "security_groups": [{"name": "tempest-securitygroup--923029789"}], "key_name": "tempest-keypair-1984984206", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:35.157329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] validate_networks() for [('ee2ac450-e56e-4c1d-8d15-c8bfd50e2024', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:25:35.558815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:25:35.559779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:25:35.560280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:25:35.560691 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:25:35.561158 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:25:35.570763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.571210 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.571997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.572433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.589785 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for project 6db8193dcee944008c7b41889bfa67a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:25:35.594660 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Getting quotas for user 468a46d55bd342739b9cd78bcd3a77fc and project 6db8193dcee944008c7b41889bfa67a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:25:35.606937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:25:35.609328 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:25:35.666175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8aa2ea4e-db40-4ec7-b162-a21529dc0514 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.629524 May 27 03:25:35.667077 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 141/291] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:25:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:25:35.673178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:35.673778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:35.680564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.681035 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.681793 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.682224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.816922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:35.825101 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:35.826640 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:35.828039 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-831db3a5-4d4e-46a4-b9aa-0e58fc1419cf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.159143 May 27 03:25:35.828596 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 142/292] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:35 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:35.833266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:35.834020 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:35.843854 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.844297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.845091 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:35.845684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:35.985577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:35.993325 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c22ee2c7-9efa-4ff5-9c01-53bfff5c90d4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.163398 May 27 03:25:35.993902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 143/293] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:35 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:35.998897 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d5c9a7ca-94de-420d-8272-b8da4658ee1d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:35.999513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d5c9a7ca-94de-420d-8272-b8da4658ee1d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:36.052694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d5c9a7ca-94de-420d-8272-b8da4658ee1d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:36.060636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d5c9a7ca-94de-420d-8272-b8da4658ee1d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1245 microversion: 2.1 time: 0.065234 May 27 03:25:36.061171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 144/294] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:35 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:36.065659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:36.066261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:36.072140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.072581 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:36.073371 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.073804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:36.211273 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:36.219878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-59f9cb3c-838e-4c4e-a3e4-c41f3fdea9b5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.157661 May 27 03:25:36.220449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 145/295] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:36 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:36.225125 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:36.226432 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:36.232518 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.232986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:36.233764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.234192 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:36.295552 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:36.303582 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4fb1f712-05dc-4bb3-9e1c-fe223e6d5df4 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1223 microversion: 2.1 time: 0.082124 May 27 03:25:36.304162 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 146/296] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:36 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:36.846524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:36.847147 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:36.858665 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.859442 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:36.860250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:36.860772 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.030116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.038823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.040359 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.041550 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-66a686fc-c89d-4599-92d0-dc34e3e7f861 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.199046 May 27 03:25:37.042110 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 147/297] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:36 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:37.046945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:37.047726 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:37.057183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.058711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.060406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.061033 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.103386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a701ca29-4a42-4700-a977-b56cbefd8d96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.512406 May 27 03:25:37.106775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 151/298] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:25:34 2022] POST /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 194 bytes in 2519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:37.146911 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:37.147922 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:37.162174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.162936 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.165054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.165508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.221748 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.230433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b80446d5-a85c-427b-936f-5d2ad2c16748 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.187036 May 27 03:25:37.233458 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 148/299] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:37 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:37.238451 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:37.239229 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:37.246052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.246534 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.247300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.247752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.255583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.264865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6dea4474-4671-46eb-b7ba-27cdd6a38983 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1297 microversion: 2.1 time: 0.138885 May 27 03:25:37.265669 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 152/300] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:37 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1297 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:37.320271 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:37.320871 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:37.327498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.328151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.328905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:37.329374 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:37.394153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.394607 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:37.402758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cade80f9-2ee6-4c8a-bb3c-ca34f7d6e9a1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1271 microversion: 2.1 time: 0.086288 May 27 03:25:37.403087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-43a8b2e1-a803-48aa-a00a-99afad3400fd tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.168115 May 27 03:25:37.406386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 153/301] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:37 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:37.408326 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 149/302] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:37 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:38.060131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:38.061049 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:38.064022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:38.070708 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.071490 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.072919 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.073742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.083958 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:38.250231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:38.250764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:38.257790 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:38.282588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.283360 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.284431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.284907 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.356551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.367647 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.369375 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.370847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b17cf126-43d5-457b-9b10-c8ebc26558c0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.315144 May 27 03:25:38.371528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 154/303] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:38 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:38.377003 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:38.377935 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:38.384213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.385190 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.386172 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.386941 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.462016 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.471329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-20cacc1f-96a7-4c89-a6fa-87ce09ed71fd tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1305 microversion: 2.1 time: 0.098309 May 27 03:25:38.471997 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 155/304] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:38 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:38.477128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:38.477957 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:38.485086 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.485683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.486437 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.487200 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.533956 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.552243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-86c63ee1-9b62-4a48-b6a0-fb34f3bbda73 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.305901 May 27 03:25:38.562134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 150/305] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:38 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:38.562134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:38.562134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:38.568303 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.568758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.569564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:38.569998 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:38.577846 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.586346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1fdcd331-980f-44c1-8dbe-02b01b56dea6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1289 microversion: 2.1 time: 0.113178 May 27 03:25:38.597873 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 156/306] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:38 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:38.707041 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:38.715649 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-509d7066-22ea-48a7-b2b1-e3a78bd1c868 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.159466 May 27 03:25:38.716214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 151/307] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:38 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:39.392616 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.393342 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.399575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.400025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.400784 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.401255 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.489005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.489700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.497350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.497789 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.498746 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.499325 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.549862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.559609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.561402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.562662 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dde6c6f6-b0a7-4300-a843-acfb6a2bef46 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.175078 May 27 03:25:39.563406 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 157/308] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:39.579739 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.582484 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.583580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.589235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1351bf8a-3b15-4ebb-afed-2ae9706b260e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1305 microversion: 2.1 time: 0.103933 May 27 03:25:39.589989 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 152/309] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:39.594403 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.594852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.595636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.596070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.606379 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.607119 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.614305 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.614847 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.615711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.616164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.679493 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.687208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a9e94d9b-e3c0-4c57-b209-2e1dd312c0f6 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1289 microversion: 2.1 time: 0.085413 May 27 03:25:39.688253 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 153/310] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:39.733458 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:39.734376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:39.741175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.741632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.742400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:39.742832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:39.743939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.753823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3e27122c-c0b0-4942-a0de-87583e13fb63 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.179170 May 27 03:25:39.754583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 158/311] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:39.875492 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:39.877826 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:39.885059 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3f6cd429-18f8-4aeb-8419-b12885fdb5da tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.156028 May 27 03:25:39.885633 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 154/312] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:39 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:40.582130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:40.583056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:40.590130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.590582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.591419 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.591911 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.606650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:40.607269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:40.616815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.617303 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.618083 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.618734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.683568 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:40.692368 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b58b9e02-deda-4e42-a8f4-cbc4b40cd7f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1305 microversion: 2.1 time: 0.089574 May 27 03:25:40.693239 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 155/313] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:40 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:40.704797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:40.705618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:40.711889 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.712357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.713171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.713629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.785765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:40.787525 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:40.796244 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:40.797430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-91ce1219-b5bb-4bdd-82cb-ea0fb7128232 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1289 microversion: 2.1 time: 0.096780 May 27 03:25:40.798435 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:40.799853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7bce132a-551b-4101-bf1d-3af9a053f13d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.222550 May 27 03:25:40.807398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 156/314] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:40 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:40.810383 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 159/315] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:40 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:40.813446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:40.814058 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:40.819963 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.820414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.821203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.821634 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.905252 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:40.906120 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:40.913208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.913701 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.914450 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:40.914885 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:40.990579 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.000738 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3ef32a62-2225-42fa-a2ba-7aa05006bc4b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.191965 May 27 03:25:41.001351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 157/316] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:40 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:41.074127 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.082827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d41ad461-9d01-4de1-ad0c-d8bd91ba15f4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.181494 May 27 03:25:41.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 160/317] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:40 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:41.709723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:41.710330 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:41.716881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.717369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.718816 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.719261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.786680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.794950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-86638710-97cb-462c-a80c-c56542e972ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1305 microversion: 2.1 time: 0.089109 May 27 03:25:41.795585 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 158/318] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:41 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:41.814917 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:41.815662 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:41.816881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:41.817509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:41.822882 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.824384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.824859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.825000 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.825691 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.825792 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:41.826122 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.826218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:41.898628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.908658 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c8cb8efb-f464-4d53-9ae6-3639d252e002 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1289 microversion: 2.1 time: 0.098046 May 27 03:25:41.909770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 161/319] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:41 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:41.968607 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.976491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.978012 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:41.979190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b1c5aaad-579a-4bcc-9d83-91f09de60424 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.166097 May 27 03:25:41.979895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 159/320] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:41 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:42.020138 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:42.020760 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:42.027683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.028352 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.029596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.030288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.101750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:42.102517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:42.109573 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.110116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.110938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.111577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.179680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:42.191112 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bb9a53ce-8a2d-4bbb-afe9-d3a94048cdad tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.176943 May 27 03:25:42.191725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 162/321] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:42 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:42.253186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:42.262223 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-107b6bcd-a413-452e-99c2-bf720f8e7af4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.166039 May 27 03:25:42.272763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 160/322] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:42 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:42.812855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:42.813495 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:42.820978 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.821569 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.822413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.822774 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.889716 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:42.898413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bfe1a15b-1682-4074-b211-c38736678ed5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1305 microversion: 2.1 time: 0.090272 May 27 03:25:42.899219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 163/323] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:42 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:42.926535 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:42.927274 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:42.933940 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.934860 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:42.936219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:42.936795 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.003068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:43.003880 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:43.006818 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.010185 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.011762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.013231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.013858 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.019703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7c052a1f-be03-4172-9a8f-e253897429b9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1289 microversion: 2.1 time: 0.097489 May 27 03:25:43.032136 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 161/324] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:42 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:43.198939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.207859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:43.208469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:43.209416 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.211565 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.212740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2ea87790-ec1f-4b0a-98bb-4eb53637e587 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.213706 May 27 03:25:43.218051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.218502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.219285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.219737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.231281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 164/325] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:42 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:43.279623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:43.280845 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:43.317552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.318908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.321761 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.323545 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.388944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.397325 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-35999db9-5467-4877-8fc0-b0d13dae2a6c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.193307 May 27 03:25:43.398278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 162/326] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:43 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:43.534979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.546577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d5ffdff4-543d-4025-8eb4-63bb24b19033 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.270634 May 27 03:25:43.547477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 165/327] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:43 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:43.916102 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:43.916850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:43.923461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.923938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.924718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:43.925185 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:43.987680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:43.995478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d5c12f3f-9946-43ca-9a48-0fe10d9d7ce6 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1305 microversion: 2.1 time: 0.083551 May 27 03:25:43.996021 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 163/328] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:43 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1305 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:44.037235 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:44.037839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:44.044209 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.044670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.045644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.046173 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.112145 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:44.121380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ea9aa5da-bbdb-4c63-9b6c-aa57a3ca9698 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1289 microversion: 2.1 time: 0.088070 May 27 03:25:44.122001 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 166/329] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:44 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:44.231824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:44.232419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:44.238976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.239711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.240470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.240891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.415082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:44.415965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:44.423670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.424557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.426289 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.427066 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.434628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:44.444946 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:44.453967 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:44.455376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b88a027f-1f41-43f8-b457-91cc66ca55e7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.227828 May 27 03:25:44.456365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 164/330] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:44 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:44.509672 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:44.534126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:44.565133 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:44.566951 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:44.582214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.583929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.585199 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:44.586339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:44.676826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:44.691427 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-24e33336-602f-425d-b2f2-3376134ba8bd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.280738 May 27 03:25:44.692335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 167/331] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:44 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:45.014785 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:45.017099 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:45.025129 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.026614 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.028298 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.029043 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.073302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.084438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8e88f1a8-83c3-42c3-9602-99fbe886038a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.523597 May 27 03:25:45.094511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 165/332] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:44 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:45.142331 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:45.143055 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:45.156718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.157193 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.158780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.159220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.203044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.213943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e0e41a76-640b-49b1-bebf-2a1dd5a02574 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1303 microversion: 2.1 time: 0.205536 May 27 03:25:45.214677 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 168/333] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:45 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:45.235781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.243719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f6d73b3a-88d9-4049-af23-bb869e008e5c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1277 microversion: 2.1 time: 0.109022 May 27 03:25:45.244524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 166/334] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:45 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:45.475834 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:45.476431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:45.494272 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.494721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.495492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.496133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.711482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:45.712905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:45.724782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:45.727185 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.728464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.730541 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:45.731291 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:45.740330 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.752026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.755350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:45.757905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1926bda4-bc42-4906-afcb-930d16b641b3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1745 microversion: 2.20 time: 0.286002 May 27 03:25:45.761528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 169/335] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:45 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1745 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:46.000010 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:46.009805 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b51a1076-1608-4b4f-bace-83f5d697fe12 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.305184 May 27 03:25:46.019589 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 167/336] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:45 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:46.113903 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:46.114971 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:46.121818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.122268 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.123568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.124208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.229502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=14 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:46.241470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:46.244865 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:46.264929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.265764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.266111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.266545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.495972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:46.498673 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:46.507359 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b7a0aed9-291b-4748-bb4d-1822373371a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.408600 May 27 03:25:46.508664 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 170/337] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:46 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:46.514632 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:46.516028 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:46.523009 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.523698 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.524617 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.525226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.570387 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:46.580441 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0e73a064-0cd8-433d-a874-dbcbddec05c2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.352089 May 27 03:25:46.581084 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 168/338] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:46 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:46.587005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-b57f61e6-a241-462e-ab11-2d49942585b6 req-cea0a5c9-1dc0-4e39-8bbb-8e22bf4262b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f1335e-7bd8-41e9-a488-25676516cce9", "tag": "a15b4526-0b77-4d6b-9f19-4bbe94e799a3"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:46.595907 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-b57f61e6-a241-462e-ab11-2d49942585b6 req-cea0a5c9-1dc0-4e39-8bbb-8e22bf4262b3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.596628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-b57f61e6-a241-462e-ab11-2d49942585b6 req-cea0a5c9-1dc0-4e39-8bbb-8e22bf4262b3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.622301 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-b57f61e6-a241-462e-ab11-2d49942585b6 req-cea0a5c9-1dc0-4e39-8bbb-8e22bf4262b3 service nova] Creating event network-changed:a15b4526-0b77-4d6b-9f19-4bbe94e799a3 for instance a3f1335e-7bd8-41e9-a488-25676516cce9 on hv-cinder-82880 May 27 03:25:46.628761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-b57f61e6-a241-462e-ab11-2d49942585b6 req-cea0a5c9-1dc0-4e39-8bbb-8e22bf4262b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046199 May 27 03:25:46.631815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 169/339] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:46.780632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:46.781356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:46.787896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.788773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.789705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:46.790284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:46.827179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:46.841812 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5168338b-b01d-45ee-875b-1a8d5e714855 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.329077 May 27 03:25:46.842696 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 171/340] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:46 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:47.026989 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:47.027591 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:47.037665 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.038110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.038894 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.039321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.052557 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.062887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.072777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.074222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e19891b3-c121-40a6-a164-1d224713a56c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1745 microversion: 2.20 time: 0.298346 May 27 03:25:47.075016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 170/341] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:46 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1745 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:25:47.118584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8d8849a6-6f91-400d-88f3-1014cbe6e057 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: .version_select at 0x7f5e742c3ee0>, body: {"keypair": {"name": "tempest-keypair-429368223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSvdRe5ym07oVuyZm5iTopA3f+Jbr5w4XNJm8bmTP9jl8iyReexMXAXhDAK3VIcBdQ9Y2QCQmMtYzaW9GOIp74TpX9p1e25jbzqv7vB70KEJv56vjEFBq+ItdAKrlP3jg=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:47.181276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8d8849a6-6f91-400d-88f3-1014cbe6e057 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:25:47.190326 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8d8849a6-6f91-400d-88f3-1014cbe6e057 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:25:47.254038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8d8849a6-6f91-400d-88f3-1014cbe6e057 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146196 May 27 03:25:47.256804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 171/342] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:25:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:25:47.400113 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.413646 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a3d8dc7a-649b-4287-930a-2839c711c1ef tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.389627 May 27 03:25:47.415044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 172/343] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:47 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:47.508943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-4023b4c2-8814-43d0-90b0-c517ced02844 req-3a98a49b-902a-42da-b018-2cce6f7b2c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b967195a-9c2e-4f9f-9a09-65a4101b07c8", "tag": "00901745-e24d-4624-8550-b70ca512f20a"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:47.519255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-4023b4c2-8814-43d0-90b0-c517ced02844 req-3a98a49b-902a-42da-b018-2cce6f7b2c73 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.519920 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-4023b4c2-8814-43d0-90b0-c517ced02844 req-3a98a49b-902a-42da-b018-2cce6f7b2c73 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.525729 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:47.526864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:47.538068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.540809 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.541703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.549451 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-4023b4c2-8814-43d0-90b0-c517ced02844 req-3a98a49b-902a-42da-b018-2cce6f7b2c73 service nova] Creating event network-changed:00901745-e24d-4624-8550-b70ca512f20a for instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 on hv-cinder-82880 May 27 03:25:47.550216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.559537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-4023b4c2-8814-43d0-90b0-c517ced02844 req-3a98a49b-902a-42da-b018-2cce6f7b2c73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054281 May 27 03:25:47.560839 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 172/344] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:47.598711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:47.599402 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:47.614062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.614857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.616044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.616761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.750738 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.764582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3970763c-aef7-4abc-94d7-d9e18d0aa5e7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.242438 May 27 03:25:47.774809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:47.774809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:47.775965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 173/345] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:47 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:47.779124 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-93e163b5-3f9f-403d-940a-21ece2d8bc96 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.185174 May 27 03:25:47.779707 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 173/346] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:47 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:47.859980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:47.860612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:47.866615 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.867059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:47.868416 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:47.868973 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.001918 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.009521 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2a78b1d3-a010-4248-b42f-49e95c2d4e6b tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.153591 May 27 03:25:48.010058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 174/347] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:47 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:48.101215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:48.102146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:48.110111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.110653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.111506 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.111998 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.306483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.330207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.332026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.334108 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a04487a8-5395-4087-8ac7-445c65bc014f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1745 microversion: 2.20 time: 0.236283 May 27 03:25:48.346475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 174/348] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:48 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1745 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:48.430924 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:48.431525 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:48.437869 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.438577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.439497 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.440090 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.589459 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.597277 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-42c0ad4b-334c-40ff-a603-c34a602763fe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.170168 May 27 03:25:48.597846 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 175/349] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:48 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:48.781783 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:48.782294 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:48.788559 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.789064 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.789810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.790309 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.795660 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:48.796821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:48.805133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.805683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.806847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:48.810755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:48.941529 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.949763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2fa5be5c-2a23-4c07-9182-80b91c6debc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1723 microversion: 2.1 time: 0.171956 May 27 03:25:48.950612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 175/350] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:48 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:48.982954 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-541665785", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e861f168-e1a5-4542-8ee4-9759fa17a578"}], "security_groups": [{"name": "tempest-securitygroup--801170999"}], "key_name": "tempest-keypair-429368223", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:48.986094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:48.994378 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c5c31b38-9c28-45f8-8e8e-2cb782518647 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.202497 May 27 03:25:48.995212 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 176/351] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:48 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:49.027731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:49.028345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:49.034754 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.035233 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.036040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.036483 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.088114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] validate_networks() for [('e861f168-e1a5-4542-8ee4-9759fa17a578', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:25:49.171643 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.179100 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-47f6d4c1-c789-4822-8dcc-4ef202626359 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.155662 May 27 03:25:49.179738 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 177/352] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:49 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:49.354411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:49.355383 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:49.361912 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.362402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.363325 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.363831 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.467517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:25:49.468162 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:25:49.468782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:25:49.469213 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:25:49.469628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:25:49.478944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.479379 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.480181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.480631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.496227 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.498069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:25:49.502200 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:25:49.505036 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.506681 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.507884 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cd65e467-4f02-4236-9738-df4623dc36c2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1745 microversion: 2.20 time: 0.157744 May 27 03:25:49.508436 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 178/353] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:49 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:49.513781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:25:49.516430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:25:49.567700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-62e26544-279f-4da9-83a2-4e91ac837c88 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590011 May 27 03:25:49.568268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 176/354] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:25:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:25:49.580474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5be463fa-9b5b-4fd8-bfd7-4d182ced6bca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:49.581709 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5be463fa-9b5b-4fd8-bfd7-4d182ced6bca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:49.613792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:49.615158 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:49.622341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.622858 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.623736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.624180 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.648011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5be463fa-9b5b-4fd8-bfd7-4d182ced6bca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.655674 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5be463fa-9b5b-4fd8-bfd7-4d182ced6bca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1240 microversion: 2.1 time: 0.078686 May 27 03:25:49.656512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 179/355] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:49 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:49.769392 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:49.777418 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b1f0e1d7-df5e-4b59-bdcb-a740ef379716 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.167541 May 27 03:25:49.777998 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 177/356] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:49 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:49.967895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:49.968498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:49.975532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.975981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:49.976728 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:49.977199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.011574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.012170 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.018903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.019350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.020109 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.020533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.111316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.119872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-705e6847-c932-4605-a02e-64775a58c94a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1700 microversion: 2.1 time: 0.155972 May 27 03:25:50.120577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 180/357] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:49 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:50.136748 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e03dc84a-3e87-4733-b0ce-09ad29173d34 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:50.143605 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e03dc84a-3e87-4733-b0ce-09ad29173d34 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.144061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e03dc84a-3e87-4733-b0ce-09ad29173d34 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.160937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.166137 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e03dc84a-3e87-4733-b0ce-09ad29173d34 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Going to try to start instance {{(pid=117767) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 03:25:50.168654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aee1f7f2-684a-4334-8bf5-9095151a05df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.160893 May 27 03:25:50.169267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 178/358] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:50.195531 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.196178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.204152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.204608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.205414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.205848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.215235 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e03dc84a-3e87-4733-b0ce-09ad29173d34 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action" status: 202 len: 0 microversion: 2.1 time: 0.082227 May 27 03:25:50.215876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 181/359] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:25:50 2022] POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:25:50.224623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.225336 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.231519 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.231965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.232722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.233242 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.338714 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.346786 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-560aef1c-0501-464c-8281-38c4b623bbd2 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.155052 May 27 03:25:50.347397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 179/360] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:50.365643 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.373873 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e05b7f05-e52e-4ec4-84ba-09c7ca2e2f44 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1709 microversion: 2.1 time: 0.153281 May 27 03:25:50.374493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 182/361] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:50.530769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.531350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.537838 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.538285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.539046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.539480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.674273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.675559 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.682161 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.682615 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.683384 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.683981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.718980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.727183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.728832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.730125 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5804263c-232f-4f12-9f54-a4f2c0bb59fe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1745 microversion: 2.20 time: 0.205852 May 27 03:25:50.730990 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 180/362] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1745 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:50.748088 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.755614 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-68de6701-d9b5-4112-a108-894d13e3a46a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1244 microversion: 2.1 time: 0.085682 May 27 03:25:50.756182 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 183/363] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:50.794576 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:50.795176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:50.801457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.801894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.802632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:50.803056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:50.934565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:50.943816 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33f942ae-5163-4c62-ab1d-b8d36bf71822 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.153039 May 27 03:25:50.944390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 181/364] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:50 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:51.188637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:51.189345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:51.195850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.196302 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.197100 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.197540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.342023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.353399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-703cea52-86b4-4778-a9b3-4759b7529d75 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.169695 May 27 03:25:51.354164 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 184/365] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:51 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:51.364819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:51.365449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:51.372104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.372544 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.373321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.373878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.391154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:51.391764 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:51.398657 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.399110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.399852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.400316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.509567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.517655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-984f30ab-bb87-4605-a04c-7bdc847bc60d tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.156997 May 27 03:25:51.518231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 182/366] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:51 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:51.532598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.540537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-01260a00-a2c6-4c4b-a7a3-5b94f2887bd7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1709 microversion: 2.1 time: 0.153972 May 27 03:25:51.541119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 185/367] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:51 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:51.749918 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:51.750471 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:51.773570 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:51.774094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:51.774482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.775562 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.777491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.779990 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.782600 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.786676 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.787710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.788234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.881321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:51.891112 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bc6c99b4-a911-418b-bc0f-bd465260e4e4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1236 microversion: 2.1 time: 0.121846 May 27 03:25:51.894860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 186/368] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:51 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1236 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:51.961623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:51.962329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:51.969801 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.970494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:51.972082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:51.972686 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.003995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:52.032047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.045145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.047633 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.049209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1cb0ca81-35af-4ec9-8c06-5bc4ea025955 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.304047 May 27 03:25:52.049984 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 183/369] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:51 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:52.207081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-e672a1f9-9678-4d17-97f2-d7e3a6208631 req-9b59620d-6bec-4a66-b180-eff6ec87a3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f03d50-8598-4db5-b3fd-ee77a878c5e4", "name": "network-vif-plugged", "status": "completed", "tag": "af8e6fc6-1227-49b2-a57c-d9ab051c9fe9"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:52.218264 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e672a1f9-9678-4d17-97f2-d7e3a6208631 req-9b59620d-6bec-4a66-b180-eff6ec87a3ab service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.218380 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e672a1f9-9678-4d17-97f2-d7e3a6208631 req-9b59620d-6bec-4a66-b180-eff6ec87a3ab service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.232068 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-e672a1f9-9678-4d17-97f2-d7e3a6208631 req-9b59620d-6bec-4a66-b180-eff6ec87a3ab service nova] Creating event network-vif-plugged:af8e6fc6-1227-49b2-a57c-d9ab051c9fe9 for instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 on hv-cinder-82880 May 27 03:25:52.237567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-e672a1f9-9678-4d17-97f2-d7e3a6208631 req-9b59620d-6bec-4a66-b180-eff6ec87a3ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034949 May 27 03:25:52.237735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.238176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 184/370] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:52.246211 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-606e4a41-f895-4af5-8cc6-f0851bf9bbd1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.288438 May 27 03:25:52.246781 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 187/371] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:51 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:52.374466 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:52.375163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:52.381532 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.381977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.382747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.383193 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.539087 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:52.539926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:52.555182 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.555920 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.556894 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.557540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.583241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:52.606184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d37e71c5-5c40-41dc-9c71-215983afb44c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.236313 May 27 03:25:52.607211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 185/372] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:52 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:52.616559 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:52.619738 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:52.628988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.629448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:52.630284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:52.630726 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.086235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.098026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b3a4d9d2-6546-4289-8bdc-7dca41bed006 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1709 microversion: 2.1 time: 0.489489 May 27 03:25:53.102744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 186/373] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:52 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1709 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:53.107694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:53.108371 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:53.115550 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:53.128224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.128396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.131965 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.132634 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.135279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.162024 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7a2eff56-0205-46dd-9622-391c886cceba tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.627547 May 27 03:25:53.174453 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 188/374] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:52 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:53.190651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:53.191481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:53.201858 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.202459 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.203321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.203762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.260115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.278046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a7c0edc7-e8ca-48d6-930c-7c18c9c86318 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1298 microversion: 2.1 time: 0.173895 May 27 03:25:53.278652 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 187/375] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:53 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1298 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:53.291159 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:53.292107 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:53.321811 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.322570 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.323521 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.324289 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.484561 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.497470 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.499548 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.501406 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d6c6c254-4977-4bbb-b071-933984dcb656 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.325812 May 27 03:25:53.502436 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 189/376] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:53 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:53.509356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:53.518087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8da73137-fa90-440c-ab20-07368799fa47 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.237224 May 27 03:25:53.518668 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 188/377] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:53 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:53.625983 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:53.626843 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:53.639191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.646934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:53.648009 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:53.648650 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.121146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.122330 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:54.129625 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.130307 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.131406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.132050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.217886 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.225559 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ece5a5fb-0640-4f43-aa9a-2b00e3f462b3 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.604586 May 27 03:25:54.237465 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 190/378] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:53 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:54.244391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.245041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:54.266323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.266972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.267915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.273916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.348904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.358437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a2bd9d1c-9287-463d-8ca4-0085eff15036 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1709 microversion: 2.1 time: 0.242275 May 27 03:25:54.360001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 189/379] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:54.369788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-933cee18-056c-4fa0-b457-62ebd7ee8090 req-e9aa0224-2879-4341-b5b4-664d97f77e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54917ef-d32c-4303-99e3-75adc12f147e", "name": "network-vif-plugged", "status": "completed", "tag": "fe4197df-049a-453f-a110-e4a007e15f18"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:54.379418 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-933cee18-056c-4fa0-b457-62ebd7ee8090 req-e9aa0224-2879-4341-b5b4-664d97f77e40 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.380196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-933cee18-056c-4fa0-b457-62ebd7ee8090 req-e9aa0224-2879-4341-b5b4-664d97f77e40 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.399024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-933cee18-056c-4fa0-b457-62ebd7ee8090 req-e9aa0224-2879-4341-b5b4-664d97f77e40 service nova] Creating event network-vif-plugged:fe4197df-049a-453f-a110-e4a007e15f18 for instance b54917ef-d32c-4303-99e3-75adc12f147e on hv-cinder-82880 May 27 03:25:54.404565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-933cee18-056c-4fa0-b457-62ebd7ee8090 req-e9aa0224-2879-4341-b5b4-664d97f77e40 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043148 May 27 03:25:54.405458 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 190/380] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:54.416937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.417942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:54.426645 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.427197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.428105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.428623 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.510464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.510673 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.519299 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-51f9d395-7455-491d-b037-686fa560519a tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.280678 May 27 03:25:54.521431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-76a3ab39-29de-43d3-be68-b240032127ca tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1298 microversion: 2.1 time: 0.111978 May 27 03:25:54.522189 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 191/381] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:54.522497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 191/382] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:54.537857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.537857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:54.538159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:54.538159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:54.556369 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.557388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.558808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.562362 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.580183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.580607 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.581763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:54.582203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:54.658388 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:54.848069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.856595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.858468 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.859684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b245c68a-b0b8-4e0f-8ef5-5be12514545a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.336241 May 27 03:25:54.860623 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 192/383] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:54.971167 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:54.979753 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2475fd12-4ba6-4a66-a05f-998a9be2defd tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1264 microversion: 2.1 time: 0.448084 May 27 03:25:54.980338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 192/384] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:54 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1264 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:55.245238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:55.247812 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:55.254548 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.255116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.255972 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.256684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.379375 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:55.381179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:55.394603 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.395313 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.396354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.397619 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.490092 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:55.500213 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-752721b2-90a3-4c08-b617-b994498f6e37 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.258658 May 27 03:25:55.501478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 193/385] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:55 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:55.538565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:55.540845 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:55.547794 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.548393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.549057 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.549510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.687346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:55.698150 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-65670a85-7bf0-4889-b883-6f1ecf4ad898 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1709 microversion: 2.1 time: 0.323460 May 27 03:25:55.711862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 193/386] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:55 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1709 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:55.721680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:55.728414 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:55.741524 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.742260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.743217 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.743816 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.752328 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:55.762149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-613730ca-aeaa-47eb-88d5-bd3354bf7753 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.227156 May 27 03:25:55.772914 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 194/387] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:55 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:55.881699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:55.882478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:55.891124 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.891973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.892851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:55.893409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:55.988298 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.003676 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ca28036f-cd18-4973-9f8e-534a200a9249 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.288738 May 27 03:25:56.005107 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 194/388] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:55 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:56.015407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:56.017551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:56.037282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.039751 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.040324 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.043170 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.409324 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.419710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-add0d207-59df-4937-95e5-37de6453d91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1452 microversion: 2.1 time: 0.412167 May 27 03:25:56.421506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 195/389] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:56 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1452 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:56.439299 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:56.452038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:56.476354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.477073 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.486161 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.487011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.688051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.697997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.702898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.707760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4883feb5-0171-49f2-ba2f-fcdb83fb0210 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.831125 May 27 03:25:56.720467 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 195/390] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:55 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:56.742082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:56.743191 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:56.756917 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.757413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.758235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.758670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.891254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:56.903673 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b834d472-b744-47cb-99ad-477f73c8c3e7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1452 microversion: 2.1 time: 0.468272 May 27 03:25:56.905571 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 196/391] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:56 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1452 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:56.921839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-a354b525-de37-4e66-9ebc-f1679e4cf497 req-0babe23b-83e1-41a1-88d1-1e9ce561bf03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f1335e-7bd8-41e9-a488-25676516cce9", "name": "network-vif-plugged", "status": "completed", "tag": "a15b4526-0b77-4d6b-9f19-4bbe94e799a3"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:56.947619 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a354b525-de37-4e66-9ebc-f1679e4cf497 req-0babe23b-83e1-41a1-88d1-1e9ce561bf03 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:56.949219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a354b525-de37-4e66-9ebc-f1679e4cf497 req-0babe23b-83e1-41a1-88d1-1e9ce561bf03 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:56.984264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-a354b525-de37-4e66-9ebc-f1679e4cf497 req-0babe23b-83e1-41a1-88d1-1e9ce561bf03 service nova] Creating event network-vif-plugged:a15b4526-0b77-4d6b-9f19-4bbe94e799a3 for instance a3f1335e-7bd8-41e9-a488-25676516cce9 on hv-cinder-82880 May 27 03:25:56.994071 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-a354b525-de37-4e66-9ebc-f1679e4cf497 req-0babe23b-83e1-41a1-88d1-1e9ce561bf03 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085753 May 27 03:25:56.995415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 197/392] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:57.002498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:57.003644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:57.036783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.037691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.039191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.040759 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.189487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:57.221138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eb332f13-ff99-4693-bc9c-5dfec08aeb32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.491182 May 27 03:25:57.221960 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 196/393] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:56 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:57.241413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:57.243574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:57.261973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.262427 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.263598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.264112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.669510 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:57.682617 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f698250f-38fc-4f93-b8ae-e832d08ecc56 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1709 microversion: 2.1 time: 0.685181 May 27 03:25:57.683541 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 198/394] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:56 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1709 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:57.688645 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:57.689897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:57.697624 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.698306 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.699589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.700193 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.727984 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:57.739796 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-788e1155-7b38-4b5e-9f1f-cfd566a2e60f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.516854 May 27 03:25:57.740391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 197/395] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:57 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:57.747889 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-aa112480-56c1-4361-bfd4-b7d4cfdebabf req-47a58f17-beb3-4e04-a121-6dccb46b7027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e20f854-915e-4f4e-8596-b16df25a2609", "tag": "15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:57.756794 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-aa112480-56c1-4361-bfd4-b7d4cfdebabf req-47a58f17-beb3-4e04-a121-6dccb46b7027 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.757261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-aa112480-56c1-4361-bfd4-b7d4cfdebabf req-47a58f17-beb3-4e04-a121-6dccb46b7027 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.770496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-aa112480-56c1-4361-bfd4-b7d4cfdebabf req-47a58f17-beb3-4e04-a121-6dccb46b7027 service nova] Creating event network-changed:15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35 for instance 6e20f854-915e-4f4e-8596-b16df25a2609 on hv-cinder-82880 May 27 03:25:57.775897 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-aa112480-56c1-4361-bfd4-b7d4cfdebabf req-47a58f17-beb3-4e04-a121-6dccb46b7027 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 May 27 03:25:57.776587 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 198/396] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:57.782667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:57.783653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:57.804612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.806446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:57.808098 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:57.808819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.081351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.095755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.097780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.099508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2d7e885c-e6ad-42f2-a080-ebb3b0f3b188 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.321222 May 27 03:25:58.100693 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 199/397] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:57 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:58.149159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.161585 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-06260fc0-6785-4e84-8252-f3d4c9d6bb5f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.476805 May 27 03:25:58.162968 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 199/398] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:57 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:58.238207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:58.238876 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:58.254254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.255013 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.265104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.266200 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.535520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:58.561336 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9d361a5e-3317-4a41-a84f-451df02acc0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.325958 May 27 03:25:58.562579 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 200/399] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:58 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:25:58.703027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:58.704646 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:58.711396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.712125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.713126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.713762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.762350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:58.774628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:58.799825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.800988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:58.802877 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:58.802877 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.084933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.098233 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-951d86d1-86bc-4da4-aee4-fc0fbedd5480 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.344635 May 27 03:25:59.110062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 201/400] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:58 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:59.142884 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:59.143760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:59.163849 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.202524 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-53be483e-b9cc-447e-959a-d69b7ff3c7aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1713 microversion: 2.1 time: 0.505570 May 27 03:25:59.203952 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.205171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.206111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.216280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.222400 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 200/401] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:58 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1713 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:59.247585 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-1079742b-28b5-467e-9331-7f83333aa98e req-157e155f-1680-4766-9d22-01a67c78b9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b967195a-9c2e-4f9f-9a09-65a4101b07c8", "name": "network-vif-plugged", "status": "completed", "tag": "00901745-e24d-4624-8550-b70ca512f20a"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:25:59.278517 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-1079742b-28b5-467e-9331-7f83333aa98e req-157e155f-1680-4766-9d22-01a67c78b9d3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.278961 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-1079742b-28b5-467e-9331-7f83333aa98e req-157e155f-1680-4766-9d22-01a67c78b9d3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.314024 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-1079742b-28b5-467e-9331-7f83333aa98e req-157e155f-1680-4766-9d22-01a67c78b9d3 service nova] Creating event network-vif-plugged:00901745-e24d-4624-8550-b70ca512f20a for instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 on hv-cinder-82880 May 27 03:25:59.330185 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-1079742b-28b5-467e-9331-7f83333aa98e req-157e155f-1680-4766-9d22-01a67c78b9d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102738 May 27 03:25:59.335604 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 201/402] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:25:59.345992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:59.348322 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:59.355817 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.356554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.357888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.358477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.437871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.446722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.449699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.450905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1813815b-4bc0-4d0a-b269-ff96e2fd3d2c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.319009 May 27 03:25:59.451596 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 202/403] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:25:59 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:25:59.580132 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:25:59.580749 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:25:59.582810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:59.583803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=10 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:59.599022 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.599470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.600495 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:25:59.600732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:25:59.654808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:25:59.694082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.712730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-16c32bbc-a3b8-4a55-a4c5-d8c231cbb766 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1319 microversion: 2.1 time: 0.367241 May 27 03:25:59.722481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 202/404] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:59 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:25:59.801470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:25:59.815182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b4e8ff0b-9a4a-4e3b-83d9-56beb25344f5 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.239417 May 27 03:25:59.821072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 203/405] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:25:59 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:00.122000 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:00.123772 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:00.138553 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:00.141054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.142095 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.143214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.144054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.398193 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.409246 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-81d490cf-a180-448f-ba5d-db25e79e3cdc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.297023 May 27 03:26:00.409806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 203/406] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:00 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:00.469356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:00.470411 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:00.477958 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.478968 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.480081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.480720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.640833 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.649904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.651733 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.652946 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f78a02e9-749e-4b4d-8db8-82c404fb4d8d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.188104 May 27 03:26:00.664037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 204/407] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:00 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:00.730238 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:00.731826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:00.738510 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.739534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.740543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.741218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.758433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-ed38bd93-9c3e-476f-a250-b329b89d65f3 req-44e511f5-f4ae-4d57-b825-1b2cc7a1199f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f03d50-8598-4db5-b3fd-ee77a878c5e4", "tag": "af8e6fc6-1227-49b2-a57c-d9ab051c9fe9"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:00.769502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-ed38bd93-9c3e-476f-a250-b329b89d65f3 req-44e511f5-f4ae-4d57-b825-1b2cc7a1199f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.769941 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-ed38bd93-9c3e-476f-a250-b329b89d65f3 req-44e511f5-f4ae-4d57-b825-1b2cc7a1199f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.795891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-ed38bd93-9c3e-476f-a250-b329b89d65f3 req-44e511f5-f4ae-4d57-b825-1b2cc7a1199f service nova] Creating event network-changed:af8e6fc6-1227-49b2-a57c-d9ab051c9fe9 for instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 on hv-cinder-82880 May 27 03:26:00.812796 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-ed38bd93-9c3e-476f-a250-b329b89d65f3 req-44e511f5-f4ae-4d57-b825-1b2cc7a1199f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058285 May 27 03:26:00.814297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 205/408] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:26:00.834982 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:00.835588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:00.843494 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.848005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.849890 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:00.852753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:00.950839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:00.959424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c6d099b5-c305-40d0-a2d6-7634d10d6a7f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1507 microversion: 2.1 time: 0.233260 May 27 03:26:00.968987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 204/409] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:00 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:01.138563 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.151217 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-95ddabab-47db-4743-9f19-5d5cbc3fc82c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.320457 May 27 03:26:01.153950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 206/410] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:00 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:01.427636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:01.428867 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:01.441753 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.442197 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.456862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.457354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.507917 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:01.673218 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:01.673828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:01.682972 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.687134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.687968 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:01.688412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:01.862540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.878538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-091cfd1e-19fb-41c9-ae85-84dbc10d5607 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.452941 May 27 03:26:01.892277 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 205/411] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:01 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:01.944333 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.955355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.958457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:01.959937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-245d6c61-de3f-4eed-8cf1-e2d30cce1a86 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.292198 May 27 03:26:01.961060 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 207/412] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:01 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:02.172528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:02.173390 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:02.180174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.181106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.182174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.182612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.361179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:02.368963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a3fa802b-5366-4b83-a970-b26c53bd9d4a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.200921 May 27 03:26:02.369542 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 206/413] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:02 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:02.901300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:02.902245 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:02.909165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.909985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.910771 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.911206 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.983380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:02.984813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:02.991576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.992204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:02.993324 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:02.993908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:03.076477 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:03.085011 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8a8f3265-c213-424d-86d8-01cf7079e310 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.189116 May 27 03:26:03.097415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 208/414] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:02 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:03.144941 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:03.153842 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:03.155961 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:03.157185 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3c591381-e72f-4076-8ccf-a43eaf01a791 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.178699 May 27 03:26:03.160029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 207/415] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:02 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:03.386080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:03.387026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:03.395224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:03.395749 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:03.396724 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:03.397456 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:03.556625 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:03.564943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e9b33c30-fa44-47f4-a51c-f385b9737776 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.182391 May 27 03:26:03.574318 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 209/416] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:03 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:04.103913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:04.104454 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:04.111989 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.112457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.113239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.113839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.176344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:04.177769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:04.185295 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.186147 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.187516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.188140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.205988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:04.285941 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.295184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c682c367-1cce-4771-ab90-a158e31c7b8f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.195032 May 27 03:26:04.305503 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 208/417] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:04 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:04.362990 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.371899 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.374058 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.375237 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9622f26a-8feb-433f-9407-a310e7ab861e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.203117 May 27 03:26:04.375788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 210/418] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:04 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:04.587816 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:04.589112 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:04.597612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.598063 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.599309 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:04.599751 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:04.751441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:04.760525 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d8b07e2e-3bbb-44e8-90da-63856fdd9d79 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.177086 May 27 03:26:04.771130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 209/419] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:04 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:05.311853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:05.313167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:05.322228 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.323065 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.323997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.324585 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.394511 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:05.395091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:05.406387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.409093 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.410105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.410831 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.522564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:05.530995 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-78366458-92f4-43b5-b32b-7532963cfafc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.223106 May 27 03:26:05.532674 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 211/420] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:05 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:05.765630 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:05.779120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:05.780784 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:05.792169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.794634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:05.802555 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:05.803608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.805508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:05.807467 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-aa45739e-7459-41c7-b6cc-19536b3527e8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.417007 May 27 03:26:05.808146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:05.823552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 210/421] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:05 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:06.119091 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.127869 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e9ea9d17-59f9-43f4-a836-b3cc3c5df540 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1370 microversion: 2.1 time: 0.353289 May 27 03:26:06.128549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 212/422] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:05 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1370 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:06.554502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:06.555495 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:06.566797 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:06.567543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:06.568806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:06.569575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:06.707640 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.718778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3695a734-9a7f-4e70-8f29-0c7ed4cb764c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.170885 May 27 03:26:06.719356 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 211/423] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:06 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:06.831705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:06.832309 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:06.839176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:06.839624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:06.840386 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:06.840822 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:06.978436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.987276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.988806 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:06.990008 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-19088331-0b74-4f3d-8ffe-115c4f2c109a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.162303 May 27 03:26:06.990819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 213/424] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:06 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:07.149344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:07.150345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:07.160800 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.161626 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.162988 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.163743 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.312943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:07.320605 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-76c0d112-4eed-4aac-8cd0-8a88bfc786db tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1564 microversion: 2.1 time: 0.177961 May 27 03:26:07.321162 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 212/425] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:07 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:07.337218 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0db4daa7-8245-467d-919b-386acf866617 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:07.337702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0db4daa7-8245-467d-919b-386acf866617 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:07.344143 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0db4daa7-8245-467d-919b-386acf866617 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.344585 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0db4daa7-8245-467d-919b-386acf866617 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.345373 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0db4daa7-8245-467d-919b-386acf866617 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.345802 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0db4daa7-8245-467d-919b-386acf866617 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.434073 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0db4daa7-8245-467d-919b-386acf866617 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100305 May 27 03:26:07.434834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 214/426] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:26:07 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:07.736472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:07.737361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:07.745197 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.745975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.747349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:07.748160 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:07.998001 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:08.007778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-707300eb-0cd8-4fb6-9c51-e0c8bd091013 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.275136 May 27 03:26:08.008945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:08.010038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:08.018742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 213/427] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:07 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:08.023079 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:08.023975 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:08.024755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:08.025231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:08.176564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:08.184703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:08.186490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:08.187687 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-27d15e63-3ed1-4ed2-872a-a402d349a735 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.183335 May 27 03:26:08.188229 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 215/428] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:08 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:08.457757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-dcfee5b3-03af-4812-91e2-4c3e4984f833 req-570efe41-bfc7-476a-ba03-4facb1b5c35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b967195a-9c2e-4f9f-9a09-65a4101b07c8", "tag": "00901745-e24d-4624-8550-b70ca512f20a"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:08.467551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-dcfee5b3-03af-4812-91e2-4c3e4984f833 req-570efe41-bfc7-476a-ba03-4facb1b5c35e service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:08.468153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-dcfee5b3-03af-4812-91e2-4c3e4984f833 req-570efe41-bfc7-476a-ba03-4facb1b5c35e service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:08.480258 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-dcfee5b3-03af-4812-91e2-4c3e4984f833 req-570efe41-bfc7-476a-ba03-4facb1b5c35e service nova] Creating event network-changed:00901745-e24d-4624-8550-b70ca512f20a for instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 on hv-cinder-82880 May 27 03:26:08.485594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-dcfee5b3-03af-4812-91e2-4c3e4984f833 req-570efe41-bfc7-476a-ba03-4facb1b5c35e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031898 May 27 03:26:08.486193 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 214/429] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:26:09.025732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:09.026304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:09.033393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:09.033846 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.034641 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:09.035083 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.183932 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.193024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2a4bf69b-5dcc-4c47-af97-1f8babb96273 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.171313 May 27 03:26:09.203542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 216/430] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:09 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:09.207373 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:09.208178 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:09.214778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:09.215307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.216138 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:09.216840 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.359437 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.368862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.370731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:09.371908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-29ef0e42-f593-461a-a95d-bbcff374e516 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1740 microversion: 2.20 time: 0.169563 May 27 03:26:09.372469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 215/431] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:09 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:09.760580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-3057b72b-cd8d-46a0-8ebf-1529ae0a3150 req-7b716592-e9f5-4cbb-abec-1329a9d04a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e20f854-915e-4f4e-8596-b16df25a2609", "name": "network-vif-plugged", "status": "completed", "tag": "15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:09.774315 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-3057b72b-cd8d-46a0-8ebf-1529ae0a3150 req-7b716592-e9f5-4cbb-abec-1329a9d04a37 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:09.775200 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-3057b72b-cd8d-46a0-8ebf-1529ae0a3150 req-7b716592-e9f5-4cbb-abec-1329a9d04a37 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:09.792456 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-3057b72b-cd8d-46a0-8ebf-1529ae0a3150 req-7b716592-e9f5-4cbb-abec-1329a9d04a37 service nova] Creating event network-vif-plugged:15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35 for instance 6e20f854-915e-4f4e-8596-b16df25a2609 on hv-cinder-82880 May 27 03:26:09.798089 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-3057b72b-cd8d-46a0-8ebf-1529ae0a3150 req-7b716592-e9f5-4cbb-abec-1329a9d04a37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042117 May 27 03:26:09.798755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 217/432] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:10.210735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:10.211399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:10.219397 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.220115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:10.221097 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.221733 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:10.391801 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:10.392795 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:10.393587 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:10.399567 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e6440f75-9e0d-42d3-8b85-8dd045bf0535 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.193302 May 27 03:26:10.399908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.400423 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:10.400576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 216/433] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:10 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:10.401943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:10.402555 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:10.570115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:10.579004 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:10.580510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:10.581710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cf91c866-eca2-4bef-a261-a160d1b2595e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1722 microversion: 2.20 time: 0.194723 May 27 03:26:10.582254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 218/434] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:10 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:11.417530 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:11.418169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:11.424942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:11.425364 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.426129 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:11.426568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.574875 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.582947 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-57111668-4454-4fda-8135-73f44a0e1997 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.169493 May 27 03:26:11.583546 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 217/435] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:11 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:11.601414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:11.602047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:11.610222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:11.610992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.612219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:11.612928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:11.796202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.804555 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.806094 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:11.807256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e1c89580-6566-4662-ac34-a735fd81e147 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1722 microversion: 2.20 time: 0.209908 May 27 03:26:11.807823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 219/436] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:11 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:12.601523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:12.602434 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:12.614274 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.615101 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.616292 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.616783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.798292 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:12.808439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d4a0927c-eb5e-48cb-8928-54c7dbd4c941 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1365 microversion: 2.1 time: 0.211582 May 27 03:26:12.809093 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 218/437] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:12 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:12.826124 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:12.826732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:12.833428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.833827 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.834591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:12.835031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:12.972552 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:12.984854 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:12.987180 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:12.988546 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d6f082e0-c17b-4c08-b4e5-f22760bd251c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1722 microversion: 2.20 time: 0.166406 May 27 03:26:12.989139 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 220/438] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:12 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:13.698939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-1868f2ba-b4e6-4a24-937d-98e684c6abeb req-73beece2-849f-4162-aee3-2b11e133960b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54917ef-d32c-4303-99e3-75adc12f147e", "name": "network-vif-unplugged", "status": "completed", "tag": "fe4197df-049a-453f-a110-e4a007e15f18"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:13.708073 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-1868f2ba-b4e6-4a24-937d-98e684c6abeb req-73beece2-849f-4162-aee3-2b11e133960b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:13.709006 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-1868f2ba-b4e6-4a24-937d-98e684c6abeb req-73beece2-849f-4162-aee3-2b11e133960b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.720245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-1868f2ba-b4e6-4a24-937d-98e684c6abeb req-73beece2-849f-4162-aee3-2b11e133960b service nova] Creating event network-vif-unplugged:fe4197df-049a-453f-a110-e4a007e15f18 for instance b54917ef-d32c-4303-99e3-75adc12f147e on hv-cinder-82880 May 27 03:26:13.725907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-1868f2ba-b4e6-4a24-937d-98e684c6abeb req-73beece2-849f-4162-aee3-2b11e133960b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030971 May 27 03:26:13.726507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 219/439] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:13.826104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:13.826950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:13.833442 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:13.834178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.834937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:13.835368 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:13.997314 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.005712 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-421df2d5-52c4-4d44-836a-5bc58b0be4d2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1555 microversion: 2.1 time: 0.183322 May 27 03:26:14.006363 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 221/440] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:13 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:14.007881 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:14.008625 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:14.015364 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.015819 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.016786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.017262 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.024179 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2b007def-79d8-420e-951c-f900732edbc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:14.024780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2b007def-79d8-420e-951c-f900732edbc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:14.035655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b007def-79d8-420e-951c-f900732edbc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.036216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b007def-79d8-420e-951c-f900732edbc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.037030 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b007def-79d8-420e-951c-f900732edbc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:14.037465 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b007def-79d8-420e-951c-f900732edbc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:14.117821 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2b007def-79d8-420e-951c-f900732edbc3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099016 May 27 03:26:14.118426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 222/441] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:26:14 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:14.164299 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.172438 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.173966 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:14.175133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-06e7646a-edd0-46b1-b383-e2a82d63fcbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1722 microversion: 2.20 time: 0.172020 May 27 03:26:14.175693 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 220/442] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:14 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:15.194224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:15.194861 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:15.201663 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.202144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.202926 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.203363 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.388083 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-ae7f6b0e-a816-408b-b3c2-cd323bfaa7cf req-5945682e-e702-41da-9045-554b79f51a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e20f854-915e-4f4e-8596-b16df25a2609", "tag": "15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:15.396766 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ae7f6b0e-a816-408b-b3c2-cd323bfaa7cf req-5945682e-e702-41da-9045-554b79f51a9c service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:15.397468 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ae7f6b0e-a816-408b-b3c2-cd323bfaa7cf req-5945682e-e702-41da-9045-554b79f51a9c service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:15.404732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:15.413130 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:15.414802 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:15.415345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-ae7f6b0e-a816-408b-b3c2-cd323bfaa7cf req-5945682e-e702-41da-9045-554b79f51a9c service nova] Creating event network-changed:15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35 for instance 6e20f854-915e-4f4e-8596-b16df25a2609 on hv-cinder-82880 May 27 03:26:15.416247 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3247d349-8d9d-4dba-a669-ca1e8a825fbb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1722 microversion: 2.20 time: 0.226750 May 27 03:26:15.416873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 223/443] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:15 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:15.420212 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-ae7f6b0e-a816-408b-b3c2-cd323bfaa7cf req-5945682e-e702-41da-9045-554b79f51a9c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036147 May 27 03:26:15.420924 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 221/444] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:26:16.435175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:16.436830 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:16.443813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:16.444513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:16.445237 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:16.445864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:16.586798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.595175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.596673 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:16.597863 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c4fbdb14-dfe8-42fd-8b28-23978e52d13e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1722 microversion: 2.20 time: 0.166639 May 27 03:26:16.598417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 224/445] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:16 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:17.617786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:17.618465 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:17.625593 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.626034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.626789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:17.627221 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:17.771233 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:17.779744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:17.781315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:17.782481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c7fc9c6f-d2cc-4671-b40b-5b5bec7da658 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1722 microversion: 2.20 time: 0.169602 May 27 03:26:17.783056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 222/446] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:17 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:18.804583 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:18.805311 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:18.817473 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:18.818128 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:18.819249 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:18.819902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:18.959797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:18.969050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:18.970605 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:18.971831 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8fe89bbc-b6dc-4b24-83ba-b57ebe8a9aaf tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1725 microversion: 2.20 time: 0.173631 May 27 03:26:18.972388 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 225/447] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:18 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:18.992746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c8513784-4aff-40a6-8899-029f59112a7b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03cef2d7-a673-4154-8dee-6bd6fa1315f8"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:18.994041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c8513784-4aff-40a6-8899-029f59112a7b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:19.003946 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8513784-4aff-40a6-8899-029f59112a7b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.004502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8513784-4aff-40a6-8899-029f59112a7b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.005691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8513784-4aff-40a6-8899-029f59112a7b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.006303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8513784-4aff-40a6-8899-029f59112a7b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.092192 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:19.321645 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c8513784-4aff-40a6-8899-029f59112a7b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335106 May 27 03:26:19.322569 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 223/448] 10.222.0.50 () {62 vars in 1363 bytes} [Fri May 27 03:26:18 2022] POST /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:26:19.444424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0115c66c-c3e0-4277-af7e-be71fc14703a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:19.444925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0115c66c-c3e0-4277-af7e-be71fc14703a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:19.451166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0115c66c-c3e0-4277-af7e-be71fc14703a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.451623 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0115c66c-c3e0-4277-af7e-be71fc14703a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.452371 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0115c66c-c3e0-4277-af7e-be71fc14703a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.452803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0115c66c-c3e0-4277-af7e-be71fc14703a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.549416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0115c66c-c3e0-4277-af7e-be71fc14703a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/action" status: 202 len: 0 microversion: 2.20 time: 0.108922 May 27 03:26:19.550376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 226/449] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 03:26:19 2022] POST /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:26:19.558020 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:19.565381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:19.572612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.573200 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.574121 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:19.574552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:19.848749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:19.863843 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:19.865927 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:19.867708 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9b8fdf0e-aa45-4866-b21d-a7f43db81d37 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1751 microversion: 2.20 time: 0.313386 May 27 03:26:19.869700 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 224/450] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:19 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1751 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:20.887847 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:20.888410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:20.896138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:20.896590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:20.897618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:20.898058 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:20.912945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:21.034722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:21.044048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:21.045593 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:21.046757 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c96c8c47-5fec-44a3-938e-b09a606f12b1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1753 microversion: 2.20 time: 0.163370 May 27 03:26:21.047317 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 227/451] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:20 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:22.065230 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:22.065865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:22.072486 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:22.072943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:22.073716 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:22.074150 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:22.218446 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:22.227933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:22.230617 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:22.232048 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bc8c8db9-d053-4bbe-8db9-ddf4e3bcbb10 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1753 microversion: 2.20 time: 0.170750 May 27 03:26:22.232605 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 225/452] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:22 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:23.253057 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:23.253921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:23.262392 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=84 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:23.264482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:23.265116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:23.266054 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:23.267659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:23.416298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:23.425741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:23.427563 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:23.428931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0d1516fd-1195-4575-be64-3ce5d349a058 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.181765 May 27 03:26:23.443666 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 228/453] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:23 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:24.451727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:24.452340 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:24.459081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:24.459726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:24.460495 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:24.460926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:24.624632 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:24.639561 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:24.641421 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:24.645787 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8eb0455c-a71f-4418-be7f-a1ffc22698f6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.195295 May 27 03:26:24.646921 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 226/454] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:24 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:25.668460 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:25.669125 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:25.676250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:25.676700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:25.677502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:25.677937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:25.818981 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:25.828329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:25.829904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:25.831113 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-363d0241-3c72-4bbc-b86c-9525d3cd5371 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.167968 May 27 03:26:25.837130 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 229/455] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:25 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:26.112432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7cdf1b2b-d9cc-479d-8330-f8ee2b4e3715 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bf978ab-53bc-4657-8f57-557b53f5dc2c", "device": "/dev/sdb"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:26.114083 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7cdf1b2b-d9cc-479d-8330-f8ee2b4e3715 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:26.120807 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cdf1b2b-d9cc-479d-8330-f8ee2b4e3715 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.121268 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cdf1b2b-d9cc-479d-8330-f8ee2b4e3715 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.122011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cdf1b2b-d9cc-479d-8330-f8ee2b4e3715 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.122440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cdf1b2b-d9cc-479d-8330-f8ee2b4e3715 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.318043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1046987808", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:26.372933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] validate_networks() for None {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:26:26.668467 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:26:26.668896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:26:26.669516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:26:26.669798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:26:26.670213 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:26:26.679859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.680307 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.681148 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.681588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.703574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Getting quotas for project 121c8e84b0b34ac7870fd8f69d96dd8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:26:26.703574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Getting quotas for user 252f837ab93d40fe92f405a0fbffb82c and project 121c8e84b0b34ac7870fd8f69d96dd8b. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:26:26.715677 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:26:26.724987 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:26:26.775831 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-678e0039-e410-4f0f-9a3b-2ccb68e30dfa tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.461512 May 27 03:26:26.781436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 230/456] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:26:26.790532 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fb7f4c68-e01a-4fac-bbb5-ce3c98d2d618 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:26.791552 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fb7f4c68-e01a-4fac-bbb5-ce3c98d2d618 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:26.855098 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fb7f4c68-e01a-4fac-bbb5-ce3c98d2d618 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:26.862639 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fb7f4c68-e01a-4fac-bbb5-ce3c98d2d618 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1215 microversion: 2.1 time: 0.076437 May 27 03:26:26.864746 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 231/457] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:26 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:26.870069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:26.870886 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:26.877192 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.877639 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:26.879044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:26.879491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:27.030207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.038933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.040440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.041704 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d9259028-66f4-4005-aace-b9291646c90d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.175848 May 27 03:26:27.042277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 232/458] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:26 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:27.881061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:27.881959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:27.889511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:27.891833 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:27.891833 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:27.892087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:27.957942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:27.966072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b7c5436d-bac6-4d68-aecf-d923888f68ab tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.089250 May 27 03:26:27.966911 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 233/459] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:27 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:28.062383 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:28.062993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:28.071967 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.072410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:28.073222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.073662 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:28.216079 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:28.225436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:28.226954 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:28.228264 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6851fa52-063b-4ca6-b787-ccfb3f6862ff tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.170320 May 27 03:26:28.228837 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 234/460] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:28 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:28.984743 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:28.985483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:28.993269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.993720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:28.994523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:28.994957 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:29.058702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:29.067072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9f24089a-6a21-49ea-b795-7165c8582a67 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.086948 May 27 03:26:29.067638 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 235/461] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:28 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:29.247490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:29.248426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:29.255519 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:29.255968 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:29.256779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:29.257247 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:29.414276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:29.424328 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:29.425856 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:29.427073 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-03a26f9d-a268-402d-bc16-7bf29fffb7f8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.183839 May 27 03:26:29.427913 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 236/462] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:29 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:30.088028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:30.089902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:30.097308 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.097997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.099193 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.099587 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.184855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.193115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-624d8a31-0aea-49d9-875b-16365ed46099 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.111889 May 27 03:26:30.193705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 237/463] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:30 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:30.449882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:30.450474 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:30.456979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.457480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.458255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:30.458689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:30.614475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.624293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.626072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:30.627402 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9b46fa3a-0243-4708-a849-a2ad1506fa9e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.183638 May 27 03:26:30.628006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 238/464] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:30 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:31.210641 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:31.211385 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:31.218198 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.218645 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.219404 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.219826 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.284171 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:31.291803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a5bb74f9-56e1-43f9-a4ef-7ae62bc30891 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.085197 May 27 03:26:31.292368 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 239/465] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:31 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:31.645528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:31.646128 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:31.652358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.652808 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.653591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:31.654026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:31.793558 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:31.803101 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:31.804594 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:31.805798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-22f7d7b4-271f-4288-ad77-533b33840976 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.164363 May 27 03:26:31.806564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 240/466] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:31 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:32.309720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:32.310402 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:32.317320 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:32.317779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:32.318557 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:32.318999 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:32.391851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.399775 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a9e4efe5-e133-4aa9-aec1-98325412a825 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.094468 May 27 03:26:32.400280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 241/467] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:32 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:32.824463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:32.825537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:32.832730 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:32.833216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:32.834002 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:32.834440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:32.982235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.992203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.993694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:32.994868 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-951449d4-5a0a-43eb-af68-5fcdf0ee6f19 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.174560 May 27 03:26:32.995466 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 242/468] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:32 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:33.416803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:33.418202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:33.425285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.426016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.426953 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:33.427533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:33.491810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:33.500271 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4473d0c6-a325-47e4-8aa2-ce073f058f2a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.087399 May 27 03:26:33.501267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 243/469] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:33 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:34.014024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:34.014510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:34.021320 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.021775 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.022575 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.023018 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.162317 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.170887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.172398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.173587 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a3403dc6-5d8b-4bca-83b0-1f55ac354497 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.164046 May 27 03:26:34.174150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 244/470] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:34 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:34.521406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:34.522147 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:34.529151 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.529636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.530401 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:34.530911 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:34.596939 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:34.599692 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:34.606903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1b7672e7-f43c-493c-9859-8c885175f172 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.091197 May 27 03:26:34.607706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 245/471] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:34 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:35.192296 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:35.193106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:35.199723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.200167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.200919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.201380 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.348443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:35.358112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:35.359651 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:35.360827 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4ab1f978-1afa-47be-9799-11ad0e51918c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.172554 May 27 03:26:35.361397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 246/472] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:35 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:35.623817 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:35.624579 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:35.631503 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.631937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.632716 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:35.633193 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:35.697487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:35.705166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-34e071f2-a089-480c-a0f4-0fc5341cf7cd tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.085232 May 27 03:26:35.705744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 247/473] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:35 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:36.119019 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=49 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:36.198266 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=32,nova_cell1:UPDATE=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:36.379849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:36.380390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:36.389197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.389652 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.390415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.390910 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.526890 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.535679 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.537197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.538357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-386cb535-8107-4854-9dd1-5142a9a54c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.162659 May 27 03:26:36.538955 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 248/474] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:36 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:36.723008 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:36.723768 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:36.726046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:36.732562 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.733031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.733800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:36.734241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:36.798538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:36.810269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8bdd2d35-f14f-4b39-b562-a7fe17da1248 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1219 microversion: 2.1 time: 0.090879 May 27 03:26:36.811027 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 249/475] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:36 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:37.562976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:37.563851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:37.566797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=8 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:37.574235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.574682 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.575448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.575906 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.722766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.733333 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.734962 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.736128 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-76fa3d45-93ac-4449-8951-814213a528a2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.179899 May 27 03:26:37.736688 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 250/476] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:37 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:37.836410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:37.837777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:37.847774 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.848513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.849835 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:37.850557 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:37.918248 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:37.928043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-667d750f-8a35-4b4d-b940-764a10d6e5c5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1211 microversion: 2.1 time: 0.098470 May 27 03:26:37.929003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 251/477] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:37 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:38.139534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7cdf1b2b-d9cc-479d-8330-f8ee2b4e3715 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "POST /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.030910 May 27 03:26:38.140163 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 227/478] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:26:26 2022] POST /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9/os-volume_attachments => generated 194 bytes in 12032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:38.755410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:38.755971 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:38.763105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.763570 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.764398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.764829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.911035 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.921002 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.922485 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:38.923659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2269aa60-49ce-4726-8a66-8d379d233fed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.172678 May 27 03:26:38.924240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 252/479] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:38 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:38.947538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:38.948270 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:38.954747 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.955197 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:38.955996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:38.956415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:39.037105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:39.045704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ab2065f6-ca91-45f8-9698-fe55a2e96c34 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1273 microversion: 2.1 time: 0.103157 May 27 03:26:39.046290 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 228/480] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:38 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:39.942761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:39.943512 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:39.950920 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.951366 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:39.952136 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:39.952590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.063314 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:40.063938 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:40.070629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.071128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.072708 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.073067 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.104742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.114073 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.115565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.116732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c4c63d8d-a3cd-4d7e-af35-b9cf2ec7c4d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.178062 May 27 03:26:40.117350 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 253/481] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:39 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:40.300871 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:40.310402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c756cdbe-86ac-480b-bf2a-bbeb00115f7a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.251043 May 27 03:26:40.320229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 229/482] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:40 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:40.819746 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-5f84388f-41ac-4d25-a60e-7ddd08c59a3e req-b9fe6909-8c5d-4950-a750-15798b38c525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1830bf3c-810c-4108-9b89-e04a49ecfadf", "tag": "80c4b749-62fd-43fe-ad3f-fc6fdf910a68"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:40.828215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5f84388f-41ac-4d25-a60e-7ddd08c59a3e req-b9fe6909-8c5d-4950-a750-15798b38c525 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:40.828655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5f84388f-41ac-4d25-a60e-7ddd08c59a3e req-b9fe6909-8c5d-4950-a750-15798b38c525 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:40.849840 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-5f84388f-41ac-4d25-a60e-7ddd08c59a3e req-b9fe6909-8c5d-4950-a750-15798b38c525 service nova] Creating event network-changed:80c4b749-62fd-43fe-ad3f-fc6fdf910a68 for instance 1830bf3c-810c-4108-9b89-e04a49ecfadf on hv-cinder-82880 May 27 03:26:40.855417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-5f84388f-41ac-4d25-a60e-7ddd08c59a3e req-b9fe6909-8c5d-4950-a750-15798b38c525 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040230 May 27 03:26:40.856418 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 254/483] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:26:41.135697 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:41.136287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:41.143701 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.144175 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.144942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.145404 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.328683 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:41.329400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:41.337470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.337919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.338664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:41.339129 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:41.357104 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.368212 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.369677 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.370884 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f7c62c97-3caa-4690-b05d-bdbdfe99b1ea tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.239278 May 27 03:26:41.374793 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 230/484] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:41 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:41.471748 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:41.480110 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9e653c96-f91f-4f05-aa87-f96d656584ca tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.155618 May 27 03:26:41.480695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 255/485] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:41 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:42.393026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:42.394063 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:42.403043 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.403496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.404264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.404707 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.496979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:42.497631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:42.504633 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.505087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.505859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:42.506267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:42.542442 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.551315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.552725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.553911 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-73ed9240-4e82-4302-8bbe-93910688aff3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.167305 May 27 03:26:42.554469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 231/486] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:42 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:42.644654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:42.653241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-799fae89-8eea-49ab-80bb-3f80225007ad tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.160096 May 27 03:26:42.653823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 256/487] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:42 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:43.574281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:43.574860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:43.581691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.582128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.582888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.583317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.670866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:43.672275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:43.679852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.680310 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.681119 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:43.681569 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:43.728076 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:43.737683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:43.739213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:43.740443 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-218d5e05-91e1-4570-9b9f-2b0e7efbbdfc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.171720 May 27 03:26:43.741066 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 232/488] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:43 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:43.821425 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:43.832698 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1d626422-225d-4e55-9578-479cd3cbba4e tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.165673 May 27 03:26:43.833568 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 257/489] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:43 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:44.763458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:44.764449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:44.775385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.776139 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.777512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.777963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.852111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:44.852668 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:44.859586 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.860016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.860766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:44.861243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:44.952807 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.961517 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.963103 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:44.964544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-19c3f3bf-51f6-4bcb-84b3-a270ea0b5230 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.208082 May 27 03:26:44.965244 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 233/490] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:44 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:44.995716 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:45.003439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d1c55686-de64-4b26-93cb-95afef0a5268 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.155430 May 27 03:26:45.004014 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 258/491] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:44 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:45.983398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:45.984283 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:45.990915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.991632 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:45.992626 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:45.993277 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.020828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:46.021460 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:46.028749 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.029249 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.030024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:46.030461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:46.127722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.136850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.138380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.139836 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ded4be15-917f-429b-9bf9-11d051a56132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.160776 May 27 03:26:46.140418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 234/492] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:45 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:46.162905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:46.170554 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0bc79ec4-e7c4-46ea-a0b8-7f575ed4a7b1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.153584 May 27 03:26:46.171114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 259/493] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:46 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:26:47.158243 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:47.158914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:47.169478 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.170070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.171247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.171864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.187980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:47.188540 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:47.195391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.195847 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.196614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:47.197084 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:47.306862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.315588 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.317135 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.318311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b93dfa2a-ed7b-43d9-8992-33efb8f7934c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.164086 May 27 03:26:47.318880 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 235/494] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:47 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:47.329985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:47.337419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-62d48142-6c7f-4902-8d4a-ca7498d5b33a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.153477 May 27 03:26:47.337977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 260/495] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:47 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:48.336642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:48.337271 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:48.344428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.344880 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.345668 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.346105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.354324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:48.355330 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:48.362403 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.362936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.363709 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:48.364160 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:48.484824 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.494251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.496039 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.497222 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-02a02a32-fcd0-4cbc-ae94-78def6440e04 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.164424 May 27 03:26:48.497796 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 236/496] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:48 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:48.499132 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:48.506802 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f42b9c72-108e-4187-bb34-853354dfe5f8 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.156403 May 27 03:26:48.507341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 261/497] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:48 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:49.518535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:49.519108 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:49.527661 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.528165 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.529134 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.529651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.530340 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:49.530931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:49.539076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.539614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.540539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:49.541048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:49.664253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.670793 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.673486 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.674990 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:49.676151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-98fc1b13-f665-4026-956a-2361f79e01a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.162669 May 27 03:26:49.676752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 237/498] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:49 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:49.678345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a311e92e-4548-41c4-8785-acaa74957d4d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.152727 May 27 03:26:49.678896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 262/499] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:49 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:50.523249 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-e1fad25c-b88d-435c-bc1e-4bc5b74df582 req-6a5970f0-be69-4ea4-bc4c-e0d997f6ecc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1830bf3c-810c-4108-9b89-e04a49ecfadf", "name": "network-vif-plugged", "status": "completed", "tag": "80c4b749-62fd-43fe-ad3f-fc6fdf910a68"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:50.533431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e1fad25c-b88d-435c-bc1e-4bc5b74df582 req-6a5970f0-be69-4ea4-bc4c-e0d997f6ecc9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.533895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e1fad25c-b88d-435c-bc1e-4bc5b74df582 req-6a5970f0-be69-4ea4-bc4c-e0d997f6ecc9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.545692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-e1fad25c-b88d-435c-bc1e-4bc5b74df582 req-6a5970f0-be69-4ea4-bc4c-e0d997f6ecc9 service nova] Creating event network-vif-plugged:80c4b749-62fd-43fe-ad3f-fc6fdf910a68 for instance 1830bf3c-810c-4108-9b89-e04a49ecfadf on hv-cinder-82880 May 27 03:26:50.551102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-e1fad25c-b88d-435c-bc1e-4bc5b74df582 req-6a5970f0-be69-4ea4-bc4c-e0d997f6ecc9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031427 May 27 03:26:50.551754 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 238/500] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:50.694744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:50.695316 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:50.695516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:50.696436 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:50.703737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.703945 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.704273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.704423 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.705149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.705263 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:50.705570 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.705856 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:50.725392 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:50.842062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:50.850885 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:50.852498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:50.853760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a8081c91-d4b1-4b23-9110-41ccabc4e856 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.163058 May 27 03:26:50.854599 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 263/501] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:50 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:50.904655 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:50.915578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6eddbbcb-8987-42f0-9e02-a54caedcdd15 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.223922 May 27 03:26:50.916424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 239/502] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:50 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:51.876500 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:51.877499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:51.887945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.888375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.889240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.889700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.933500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:51.934075 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:51.940748 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.941224 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:51.942046 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:51.942512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:52.020512 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.030873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.032967 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.034535 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2c9ec69c-974b-4627-b4cd-3d29a6966e11 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.164455 May 27 03:26:52.035274 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 264/503] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:51 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:52.077505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:52.085433 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a72589e5-0de0-49fe-9d2e-0afbd2742b6c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.156407 May 27 03:26:52.086005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 240/504] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:51 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:53.059140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:53.059791 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:53.067829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.068355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.069299 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.069809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.104623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:53.105368 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:53.112300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.112844 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.113682 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:53.114116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:53.210755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.219688 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.221216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.222376 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f8b5d162-3de1-4a5f-b37b-2f873694ec0a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.169551 May 27 03:26:53.222937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 265/505] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:53 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:53.252330 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:53.263529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dbb9ab25-4961-4044-ac77-8944790a6871 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.164466 May 27 03:26:53.264085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 241/506] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:53 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:54.245272 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:54.246463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:54.249962 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:54.259655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.260297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.261767 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.262208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.279723 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:54.280345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:54.286972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.287423 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.288184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:54.288622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:54.398652 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.407675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.409267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.410471 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-feeacaed-af92-4169-97fc-525845ab7d4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.171992 May 27 03:26:54.411032 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 266/507] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:54 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:54.427731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:54.435403 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3ebca724-126d-48af-be9e-a03b5c4b3cda tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.159568 May 27 03:26:54.436002 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 242/508] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:54 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:55.368822 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-1413835e-cd01-4e30-b824-5b61800bd4db req-43ee0655-7ee1-4bfa-9d67-20b4a9985a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54917ef-d32c-4303-99e3-75adc12f147e", "name": "network-vif-plugged", "status": "completed", "tag": "fe4197df-049a-453f-a110-e4a007e15f18"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:26:55.378283 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-1413835e-cd01-4e30-b824-5b61800bd4db req-43ee0655-7ee1-4bfa-9d67-20b4a9985a30 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.378735 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-1413835e-cd01-4e30-b824-5b61800bd4db req-43ee0655-7ee1-4bfa-9d67-20b4a9985a30 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.393279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-1413835e-cd01-4e30-b824-5b61800bd4db req-43ee0655-7ee1-4bfa-9d67-20b4a9985a30 service nova] Creating event network-vif-plugged:fe4197df-049a-453f-a110-e4a007e15f18 for instance b54917ef-d32c-4303-99e3-75adc12f147e on hv-cinder-82880 May 27 03:26:55.398306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-1413835e-cd01-4e30-b824-5b61800bd4db req-43ee0655-7ee1-4bfa-9d67-20b4a9985a30 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033571 May 27 03:26:55.399111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 267/509] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:26:55.429505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:55.430098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:55.436913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.437428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.438160 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.438779 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.457324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:55.458328 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:55.465816 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.466361 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.467369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:55.467873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:55.594381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:55.598073 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:26:55.603736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:55.605413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:55.606593 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-23268339-825a-41c1-bcc9-15df5b8722b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.181021 May 27 03:26:55.613333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 243/510] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:55 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:55.623223 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:55.630965 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c748176b-d5fe-4067-88ff-4562aaeb1c06 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1315 microversion: 2.1 time: 0.178940 May 27 03:26:55.631543 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 268/511] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:55 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:56.628739 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:56.629756 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:56.642007 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.642449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.643183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.643770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.650290 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:56.650903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:56.658324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.658781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.659561 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.660003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.784346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.793204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.794794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.796050 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9d728907-37de-4a65-a332-682239694080 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.173687 May 27 03:26:56.796687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 244/512] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:56 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:56.800071 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:56.808831 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2d0aed96-b9a1-4a6a-956f-7a1ac9af43b7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1465 microversion: 2.1 time: 0.163520 May 27 03:26:56.809509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 269/513] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:56 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:56.818918 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:26:56.819080 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Fri May 27 03:26:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:26:56.848963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:56.849458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:56.855797 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.856245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.857013 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.857744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.882919 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:26:56.976487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-54ba6e9a-f23f-4431-90a2-118670083e71 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 204 len: 0 microversion: 2.1 time: 0.130431 May 27 03:26:56.977623 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 245/514] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:26:56 2022] DELETE /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:26:56.986694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:56.987306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:56.993410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.993859 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:56.994618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:56.995054 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.127849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.136450 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-50ee8754-a265-4bdf-ab34-cbd1dbbb1e63 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1471 microversion: 2.1 time: 0.153228 May 27 03:26:57.137198 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 270/515] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:56 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:57.815983 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:57.816654 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:57.823950 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:57.824402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.825209 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:57.825757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:57.983962 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.995745 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.997858 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:57.999677 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0d7ec491-d874-4954-bb1b-882c1fc0f328 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.187700 May 27 03:26:58.000491 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 246/516] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:57 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:26:58.154057 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:58.154631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:58.161949 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.162395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.163163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:58.163599 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:58.307688 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:58.315957 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2699a065-f105-4175-85b0-be4dabfa594d tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1471 microversion: 2.1 time: 0.165953 May 27 03:26:58.316517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 271/517] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:58 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:59.026476 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:59.027337 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:59.034814 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.035256 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.036010 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.036437 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.185085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.193606 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.195105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.196260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-59a8b435-3f39-4f71-910e-515fb438649e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.176144 May 27 03:26:59.196831 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 247/518] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:26:59 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:26:59.259744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:59.260329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:59.267763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.268190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.269003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.269419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.333153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:26:59.334111 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:26:59.340344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.340805 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.341612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:26:59.342055 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:26:59.409369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lazy-loading 'services' on Instance uuid a04444dd-f9dd-428f-b524-fba73fc83fe4 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:26:59.479701 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:26:59.487716 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-865c963c-b967-4bf2-891e-85a12eda215a tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1471 microversion: 2.1 time: 0.158480 May 27 03:26:59.488413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 248/519] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:26:59 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:26:59.532512 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5b59957f-0a33-4f24-b9e7-e222543f52ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-volume_attachments/4748d6c4-ca85-4607-948e-980fbd2c26f4" status: 202 len: 0 microversion: 2.1 time: 0.276618 May 27 03:26:59.533131 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 272/520] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:26:59 2022] DELETE /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-volume_attachments/4748d6c4-ca85-4607-948e-980fbd2c26f4 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:00.214945 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:00.215564 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:00.222533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.222973 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:00.223726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.224184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:00.363258 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:00.372207 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:00.373815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:00.374972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b42f2714-b6c8-481f-a647-bf9a8c438bd1 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.163993 May 27 03:27:00.375520 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 249/521] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:00 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:00.510631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:00.511808 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:00.522543 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.523152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:00.524294 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:00.525310 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:00.661370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:00.669234 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ac3fc471-e6ce-4d48-ad83-72e9fed572c1 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1471 microversion: 2.1 time: 0.166426 May 27 03:27:00.669848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 273/522] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:00 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:01.394439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:01.394995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:01.401989 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:01.402446 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:01.403216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:01.403663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:01.543311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.551695 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.553229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.554385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bfdd09ac-94d8-4996-a307-0580653978a6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.164123 May 27 03:27:01.554914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 250/523] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:01 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:27:01.687157 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:01.688339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:01.695703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:01.696156 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:01.696977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:01.697420 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:01.830650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:01.842012 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ac64ed19-81da-4b8f-bde4-7ac98d1b506c tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1471 microversion: 2.1 time: 0.158670 May 27 03:27:01.843145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 274/524] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:01 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:02.577082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:02.577934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:02.586316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.586767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:02.587538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.587973 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:02.734531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:02.743164 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:02.744676 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:02.745872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-08d2dd7c-56c3-48ea-ac65-1ff98f79b235 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.175623 May 27 03:27:02.746462 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 251/525] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:02 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:02.867185 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:02.867541 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:02.874748 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.875205 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:02.875980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:02.876421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.046791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:03.047402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:03.053782 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.054234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.055009 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.055427 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.078906 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.086933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-116e9771-0579-4dce-9662-5de875682be5 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1471 microversion: 2.1 time: 0.224198 May 27 03:27:03.087895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 275/526] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:02 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:03.187796 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lazy-loading 'services' on Instance uuid a3f1335e-7bd8-41e9-a488-25676516cce9 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:03.330049 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-acc86425-f103-48e3-aa55-a890130ace68 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9/os-volume_attachments/7bf978ab-53bc-4657-8f57-557b53f5dc2c" status: 202 len: 0 microversion: 2.1 time: 0.286983 May 27 03:27:03.331633 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 252/527] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:27:03 2022] DELETE /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9/os-volume_attachments/7bf978ab-53bc-4657-8f57-557b53f5dc2c => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:03.352827 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-a5efe3db-8f9c-4817-9fe2-49c35fdbe41a req-f2415d1c-0bff-431a-bf29-3376d1fbe732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1830bf3c-810c-4108-9b89-e04a49ecfadf", "name": "network-vif-deleted", "tag": "80c4b749-62fd-43fe-ad3f-fc6fdf910a68"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:03.361589 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a5efe3db-8f9c-4817-9fe2-49c35fdbe41a req-f2415d1c-0bff-431a-bf29-3376d1fbe732 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.362098 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a5efe3db-8f9c-4817-9fe2-49c35fdbe41a req-f2415d1c-0bff-431a-bf29-3376d1fbe732 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.373901 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-a5efe3db-8f9c-4817-9fe2-49c35fdbe41a req-f2415d1c-0bff-431a-bf29-3376d1fbe732 service nova] Creating event network-vif-deleted:80c4b749-62fd-43fe-ad3f-fc6fdf910a68 for instance 1830bf3c-810c-4108-9b89-e04a49ecfadf on hv-cinder-82880 May 27 03:27:03.379263 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-a5efe3db-8f9c-4817-9fe2-49c35fdbe41a req-f2415d1c-0bff-431a-bf29-3376d1fbe732 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030011 May 27 03:27:03.379992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 276/528] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:03.765629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:03.766322 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:03.773560 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.774004 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.774774 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:03.775390 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:03.912634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.921296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.922775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:03.923913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a6815b36-62b4-4bf2-803c-4ff94df33f31 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.163603 May 27 03:27:03.924533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 253/529] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:03 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:04.111125 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:04.112553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:04.119389 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.119833 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.120582 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.121038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.153076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.153513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.154058 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lazy-loading 'fault' on Instance uuid 1830bf3c-810c-4108-9b89-e04a49ecfadf {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:04.210115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:04.218476 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-947818b1-22a7-48d8-a7c9-7c71fe74c963 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1305 microversion: 2.1 time: 0.115092 May 27 03:27:04.219048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 277/530] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:04 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:04.884796 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d6f9d907-0ef7-4b2d-b15f-c59c1187b328 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:04.892188 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d6f9d907-0ef7-4b2d-b15f-c59c1187b328 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.892746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d6f9d907-0ef7-4b2d-b15f-c59c1187b328 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.915227 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d6f9d907-0ef7-4b2d-b15f-c59c1187b328 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Going to try to stop instance {{(pid=117767) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 03:27:04.945053 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:04.945614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:04.952900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.954017 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.954993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.955608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.972180 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d6f9d907-0ef7-4b2d-b15f-c59c1187b328 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action" status: 202 len: 0 microversion: 2.1 time: 0.091084 May 27 03:27:04.973855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 254/531] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:27:04 2022] POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:04.982687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:04.983648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:04.993938 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.994765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:04.996168 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:04.997225 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.123051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.133026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.134571 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.135894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8e590b5e-07d1-46e6-af0e-e4cab7f2d1b6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1809 microversion: 2.20 time: 0.196175 May 27 03:27:05.136809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 278/532] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:04 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:05.146956 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.155038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e3b7a170-7341-4517-b8b9-534c9dcc43c5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.176595 May 27 03:27:05.155705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 255/533] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:04 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:05.237251 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:05.237779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:05.244227 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:05.244680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.245478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:05.246167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.282471 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:05.282919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:05.283399 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lazy-loading 'fault' on Instance uuid 1830bf3c-810c-4108-9b89-e04a49ecfadf {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:05.324808 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252f837ab93d40fe92f405a0fbffb82c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c8e84b0b34ac7870fd8f69d96dd8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:05.327480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:05.336430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bef54256-a75f-45a3-a703-44ee6a5044e6 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 200 len: 1305 microversion: 2.1 time: 0.102876 May 27 03:27:05.337575 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 279/534] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:05 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:06.154821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:06.155387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:06.157862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:06.163420 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.163868 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.164641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.165109 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.173800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:06.174419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:06.181500 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.181957 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.182761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.183205 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.306108 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.314766 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.316249 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.317516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0394fd6d-5cc9-41c6-b238-4fd8cd04bf67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1796 microversion: 2.20 time: 0.166733 May 27 03:27:06.319218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 256/535] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:06 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1796 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:06.321678 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.331392 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0221c67c-9b6f-4d87-a21c-fd952f8f0cb3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.162135 May 27 03:27:06.332292 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 280/536] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:06 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:06.354515 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:06.355709 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] [instance: 1830bf3c-810c-4108-9b89-e04a49ecfadf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:06.362454 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.362907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.363684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.364120 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.372392 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:06.386736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] HTTP exception thrown: Instance 1830bf3c-810c-4108-9b89-e04a49ecfadf could not be found. May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Request method failure captured: May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf HTTP/1.1 May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikETgBQL9_eZfXr1v4fvgHzFVo9e-9cZX7phmC37Q-KPl0zKD-SQxIJB8-tOBThMeq27Qla7_IQwTDwlloMeSvP4te-TbryVT12ZUdC1psfG-VlR1XfmjO8Lls0J7v8bBWvKlB4Q0Bq18ooJa0XwTtxc__TDpxCn1-vtvJXYd-UVKAr8 May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 121c8e84b0b34ac7870fd8f69d96dd8b May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesNegativeTest-1259782393 May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:27:06.389487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/121c8e84b0b34ac7870fd8f69d96dd8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_121c8e84b0b34ac7870fd8f69d96dd8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/121c8e84b0b34ac7870fd8f69d96dd8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/121c8e84b0b34ac7870fd8f69d96dd8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesNegativeTest-1259782393 May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 121c8e84b0b34ac7870fd8f69d96dd8b May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesNegativeTest-1259782393 May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesNegativeTest-1259782393-project May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 252f837ab93d40fe92f405a0fbffb82c May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesNegativeTest-1259782393-project May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 1830bf3c-810c-4108-9b89-e04a49ecfadf could not be found. May 27 03:27:06.390823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '1830bf3c-810c-4108-9b89-e04a49ecfadf'} May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1830bf3c-810c-4108-9b89-e04a49ecfadf could not be found. May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:06.391675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1830bf3c-810c-4108-9b89-e04a49ecfadf could not be found. May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1830bf3c-810c-4108-9b89-e04a49ecfadf could not be found. May 27 03:27:06.392838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:06.395284 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] Returning 404 to user: Instance 1830bf3c-810c-4108-9b89-e04a49ecfadf could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:06.396893 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3d38272f-540d-45e2-8f46-c7b3826cfef7 tempest-VolumesNegativeTest-1259782393 tempest-VolumesNegativeTest-1259782393-project] 10.222.0.50 "GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf" status: 404 len: 111 microversion: 2.1 time: 0.045904 May 27 03:27:06.400818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 257/537] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:06 2022] GET /compute/v2.1/servers/1830bf3c-810c-4108-9b89-e04a49ecfadf => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:27:06.595640 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:06.596430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:06.604520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.605009 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.605786 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.606255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.632591 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:27:06.717873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b97b240a-3d3f-47e4-8453-11f834249cff tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 204 len: 0 microversion: 2.1 time: 0.127604 May 27 03:27:06.718751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 281/538] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:27:06 2022] DELETE /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:27:06.727502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:06.728105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:06.735112 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.735549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.736349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:06.736772 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:06.885091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:06.893234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1d93cbc1-98f3-4e2c-82f4-cf789274c3b0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1513 microversion: 2.1 time: 0.169979 May 27 03:27:06.893797 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 258/539] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:06 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:07.349850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:07.350562 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:07.357624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:07.358182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:07.359058 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:07.359646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:07.502436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:07.510601 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ab391dc4-f96c-4067-b357-b22c2a06522a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.165172 May 27 03:27:07.511520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 282/540] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:07 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:07.911137 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:07.911974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:07.918598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:07.919045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:07.919803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:07.920232 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:08.051364 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:08.059659 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-73617b31-d13d-449a-a0c5-77c0c7eb1227 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1513 microversion: 2.1 time: 0.152310 May 27 03:27:08.060233 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 259/541] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:07 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:08.527746 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:08.528374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:08.535437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:08.535976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:08.536688 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:08.537181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:08.675954 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:08.684278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-47d39b2c-b524-469d-9999-9f84aec06416 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.160443 May 27 03:27:08.684915 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 283/542] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:08 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:09.077075 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:09.077892 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:09.084945 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.085445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.086223 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.086660 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.234398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:09.242291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4e6724f5-9e67-465d-9d21-d40b1aade043 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1513 microversion: 2.1 time: 0.169202 May 27 03:27:09.242862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 260/543] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:09 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:09.693399 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-a6aa3d78-ce7a-4f29-925b-be1c33c775de req-8b745403-0910-4a1e-a86c-7831547ea208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f1335e-7bd8-41e9-a488-25676516cce9", "name": "network-vif-deleted", "tag": "a15b4526-0b77-4d6b-9f19-4bbe94e799a3"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:09.703013 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a6aa3d78-ce7a-4f29-925b-be1c33c775de req-8b745403-0910-4a1e-a86c-7831547ea208 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.703431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:09.703547 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a6aa3d78-ce7a-4f29-925b-be1c33c775de req-8b745403-0910-4a1e-a86c-7831547ea208 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.704197 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:09.710814 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.711285 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.712041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:09.712481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:09.725047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-a6aa3d78-ce7a-4f29-925b-be1c33c775de req-8b745403-0910-4a1e-a86c-7831547ea208 service nova] Creating event network-vif-deleted:a15b4526-0b77-4d6b-9f19-4bbe94e799a3 for instance a3f1335e-7bd8-41e9-a488-25676516cce9 on hv-cinder-82880 May 27 03:27:09.731431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-a6aa3d78-ce7a-4f29-925b-be1c33c775de req-8b745403-0910-4a1e-a86c-7831547ea208 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041122 May 27 03:27:09.732049 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 284/544] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:09.848945 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:09.857667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6b4e3133-be94-4936-a769-1a3cd7ee9de3 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.159418 May 27 03:27:09.858262 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 261/545] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:09 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:10.266627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:10.267537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:10.281348 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.282251 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.284495 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.285177 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.324073 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.324666 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.325269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lazy-loading 'fault' on Instance uuid a3f1335e-7bd8-41e9-a488-25676516cce9 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:10.372695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:10.381186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-074c5aee-9f6a-475e-a1ff-23c515c079eb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 200 len: 1309 microversion: 2.1 time: 0.121107 May 27 03:27:10.381780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 285/546] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:10 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:10.875634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:10.876223 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:10.883865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.884221 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:10.885055 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:10.885502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:11.026407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:11.034552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-50c1533f-8611-4f62-b25d-901e34df1a07 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.162894 May 27 03:27:11.035138 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 262/547] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:10 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:11.403374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:11.404362 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: a3f1335e-7bd8-41e9-a488-25676516cce9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:11.415564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:11.416300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:11.417648 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:11.418357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:11.437344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] HTTP exception thrown: Instance a3f1335e-7bd8-41e9-a488-25676516cce9 could not be found. May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Request method failure captured: May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 HTTP/1.1 May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikESs7J1AlwkO9rDu3hpbYxu9Z-8VDRqeOEEnCbWsN31u3HDdGjVx9RrfBrbpDl6w7gKf9OTtsAb9U7nQckgSePPaQjJI2NXqs2NbLRI2rAYqhb-c6yuAUa4uySB25Y5tZ1S_Y4l-ECwO3_yL4uLvclK1GGe-4G8ygLqMs_EJroaKZvU May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 4052d211d2a346d8be95d6ac7761defb May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1582536527 May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:27:11.438964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesSnapshotTestJSON-1582536527 May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 4052d211d2a346d8be95d6ac7761defb May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1582536527 May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesSnapshotTestJSON-1582536527-project May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: f0fbd32e5751496e8eaaf3bd03d8f833 May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesSnapshotTestJSON-1582536527-project May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance a3f1335e-7bd8-41e9-a488-25676516cce9 could not be found. May 27 03:27:11.440421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'a3f1335e-7bd8-41e9-a488-25676516cce9'} May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f1335e-7bd8-41e9-a488-25676516cce9 could not be found. May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:11.441497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f1335e-7bd8-41e9-a488-25676516cce9 could not be found. May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f1335e-7bd8-41e9-a488-25676516cce9 could not be found. May 27 03:27:11.442864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:11.444461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Returning 404 to user: Instance a3f1335e-7bd8-41e9-a488-25676516cce9 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:11.444461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8ea381f5-d74e-48ce-ad4f-caf5070b2344 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9" status: 404 len: 111 microversion: 2.1 time: 0.043632 May 27 03:27:11.444461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 286/548] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:11 2022] GET /compute/v2.1/servers/a3f1335e-7bd8-41e9-a488-25676516cce9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:27:12.056900 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:12.057953 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:12.068448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.068890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:12.069681 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:12.070110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:12.215346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:12.223384 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f414b13b-06b8-49fb-8073-823274c65fab tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.173202 May 27 03:27:12.224432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 263/549] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:12 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:13.246550 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:13.247134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:13.254174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:13.254675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:13.255439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:13.255872 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:13.385016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:13.392917 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fbbbdd41-e2d5-41f5-a6d7-dc384c93dc94 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.150274 May 27 03:27:13.393491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 287/550] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:13 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:14.416304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:14.416892 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:14.423379 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.423835 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:14.424627 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:14.425088 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:14.561914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:14.569680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-814bb8cb-fd82-4bd4-a752-1703ad947c67 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.157451 May 27 03:27:14.570249 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 264/551] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:14 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:15.591387 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:15.592277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:15.602142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:15.602588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.603341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:15.603768 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:15.749722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:15.757815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-84b8a1e0-4e9a-4986-9fd2-da28e9b2824d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.173153 May 27 03:27:15.758378 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 288/552] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:15 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:16.779960 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:16.780597 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:16.787737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.788189 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:16.788975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:16.789409 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:16.923916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:16.932670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f57634d7-eff3-4837-b959-734bc89ec91a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.156614 May 27 03:27:16.933288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 265/553] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:16 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:17.954186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:17.955233 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:17.966476 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:17.967213 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:17.968446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:17.969308 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:18.138464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:18.148816 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f256a369-39f9-429e-9089-a18e6fdc391f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.201175 May 27 03:27:18.149449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 289/554] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:17 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:19.171482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:19.172074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:19.179204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.179651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.180412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.180846 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.308852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98bbd77f-41ea-438e-b78c-2d9f3eebb5b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5881c651-96ab-4b4a-aeca-ee789e8a7e38"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:19.312843 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-98bbd77f-41ea-438e-b78c-2d9f3eebb5b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:19.319872 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98bbd77f-41ea-438e-b78c-2d9f3eebb5b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.320427 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98bbd77f-41ea-438e-b78c-2d9f3eebb5b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.321290 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98bbd77f-41ea-438e-b78c-2d9f3eebb5b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.321810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98bbd77f-41ea-438e-b78c-2d9f3eebb5b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.327249 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:19.335383 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b12261e5-4c8a-4a07-b95f-4dee728e93a5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.168647 May 27 03:27:19.346303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 266/555] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:19 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:19.373196 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2111033032", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "networks": [{"uuid": "d552a4c8-1cfd-43a0-b4ee-dbad181ed1bf"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:19.423954 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] validate_networks() for [('d552a4c8-1cfd-43a0-b4ee-dbad181ed1bf', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:27:19.588599 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-98bbd77f-41ea-438e-b78c-2d9f3eebb5b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284907 May 27 03:27:19.589566 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 290/556] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:27:19 2022] POST /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:19.781494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:27:19.781778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:27:19.782393 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:27:19.782794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:27:19.783227 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:27:19.792737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.793210 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.793990 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:19.794415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:19.810883 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Getting quotas for project 4052d211d2a346d8be95d6ac7761defb. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:27:19.814829 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Getting quotas for user f0fbd32e5751496e8eaaf3bd03d8f833 and project 4052d211d2a346d8be95d6ac7761defb. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:27:19.825838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:27:19.828225 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:27:19.876762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c97f1bb5-c389-4af7-9a81-f3c442e8a9af tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507439 May 27 03:27:19.877619 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 267/557] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:27:19.889067 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b08a23b2-97e0-447f-b42b-ab9803343cb3 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:19.889764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b08a23b2-97e0-447f-b42b-ab9803343cb3 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:19.948048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b08a23b2-97e0-447f-b42b-ab9803343cb3 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:19.954942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b08a23b2-97e0-447f-b42b-ab9803343cb3 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1219 microversion: 2.1 time: 0.070490 May 27 03:27:19.955520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 291/558] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:19 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:20.353392 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:20.354159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:20.360739 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.361236 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.362040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.362658 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.495308 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:20.503177 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d82daee6-f852-4d65-87ed-cb2f0c6609a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1677 microversion: 2.1 time: 0.154281 May 27 03:27:20.503729 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 268/559] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:20 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:20.975190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:20.975857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:20.983105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.983544 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:20.984400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:20.984836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.047582 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:21.056086 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2748d5e6-eb2f-4bda-84a8-fd79101390f9 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1279 microversion: 2.1 time: 0.087802 May 27 03:27:21.056688 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 292/560] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:20 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:21.521311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:21.522084 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:21.528865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.529351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.530120 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.530556 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.664208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:21.671722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-887a327a-13b0-4578-ba52-35f1ff05d404 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1654 microversion: 2.1 time: 0.154474 May 27 03:27:21.672372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 269/561] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:21 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:21.688860 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-baeba4d0-5a40-4ded-84df-df697c5aa081 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:21.696165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baeba4d0-5a40-4ded-84df-df697c5aa081 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.696719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baeba4d0-5a40-4ded-84df-df697c5aa081 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.766300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-baeba4d0-5a40-4ded-84df-df697c5aa081 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Going to try to start instance {{(pid=117766) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 03:27:21.812504 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-baeba4d0-5a40-4ded-84df-df697c5aa081 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action" status: 202 len: 0 microversion: 2.1 time: 0.127759 May 27 03:27:21.813434 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 293/562] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:27:21 2022] POST /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:21.821886 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:21.822769 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:21.830379 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.830896 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.831766 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:21.832577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:21.996011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:22.004420 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c66ea133-34fc-4eba-8ec5-8b8dcee2f468 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1663 microversion: 2.1 time: 0.186679 May 27 03:27:22.005072 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 270/563] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:21 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1663 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:22.075498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:22.076047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:22.083154 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.084027 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.085114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.085553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.102643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:22.315219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:22.324559 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8d7c5659-c183-4193-954e-0f613c256c78 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1319 microversion: 2.1 time: 0.253494 May 27 03:27:22.325380 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 294/564] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:22 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:22.630727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-9e2c250d-1dbe-4fb2-847e-7d37cd73c1b0 req-c9c79367-3db9-425a-aa4e-5aa1066d0b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0360f3b9-e443-4d35-89a4-6f981918f34a", "tag": "884547de-07f3-4f0b-bce0-549d72cba67d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:22.640109 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-9e2c250d-1dbe-4fb2-847e-7d37cd73c1b0 req-c9c79367-3db9-425a-aa4e-5aa1066d0b1b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:22.640583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-9e2c250d-1dbe-4fb2-847e-7d37cd73c1b0 req-c9c79367-3db9-425a-aa4e-5aa1066d0b1b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:22.652432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-9e2c250d-1dbe-4fb2-847e-7d37cd73c1b0 req-c9c79367-3db9-425a-aa4e-5aa1066d0b1b service nova] Creating event network-changed:884547de-07f3-4f0b-bce0-549d72cba67d for instance 0360f3b9-e443-4d35-89a4-6f981918f34a on hv-cinder-82880 May 27 03:27:22.657325 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-9e2c250d-1dbe-4fb2-847e-7d37cd73c1b0 req-c9c79367-3db9-425a-aa4e-5aa1066d0b1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030373 May 27 03:27:22.657925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 271/565] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:23.023912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:23.024551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:23.030902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.031355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.032115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.032574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.162323 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:23.170517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d3f01596-6e97-462d-8f7d-d1439e2601db tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1663 microversion: 2.1 time: 0.150807 May 27 03:27:23.171095 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 295/566] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:23 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:23.346824 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:23.347872 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:23.358200 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.358878 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.360023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:23.360684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:23.499709 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:23.512286 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b4cacdf5-1625-439e-85a8-2dff7290bf4e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1319 microversion: 2.1 time: 0.172025 May 27 03:27:23.513129 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 272/567] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:23 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:24.192056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:24.193091 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.204718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.205516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.206770 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.207496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.326418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-50080625-82d3-4449-950a-c44544639940 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:24.327015 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-50080625-82d3-4449-950a-c44544639940 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.333438 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50080625-82d3-4449-950a-c44544639940 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.334053 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50080625-82d3-4449-950a-c44544639940 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.335419 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50080625-82d3-4449-950a-c44544639940 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.335854 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50080625-82d3-4449-950a-c44544639940 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.352529 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:24.360354 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-40b0f5e3-d0ea-4e25-8b00-7fbc0f3742aa tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1667 microversion: 2.1 time: 0.174724 May 27 03:27:24.360976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 296/568] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:24 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1667 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:24.362893 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-50080625-82d3-4449-950a-c44544639940 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609/ips" status: 200 len: 149 microversion: 2.1 time: 0.040298 May 27 03:27:24.363469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 273/569] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:27:24 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:24.376865 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db775cf2-4493-42ae-b434-4c732475e8af"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:24.378219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.380276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:24.386508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.386947 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.387706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.388135 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.471534 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Invalid volume: volume db775cf2-4493-42ae-b434-4c732475e8af is already attached to instances: d00e4700-28c6-4440-83e4-c3d1a86a75c7 May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: POST /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609/os-volume_attachments HTTP/1.1 May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 74 May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:27:24.472985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {"volumeAttachment": {"volumeId": "db775cf2-4493-42ae-b434-4c732475e8af"}} May 27 03:27:24.474243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Invalid volume: volume db775cf2-4493-42ae-b434-4c732475e8af is already attached to instances: d00e4700-28c6-4440-83e4-c3d1a86a75c7 May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'server_id': '6e20f854-915e-4f4e-8596-b16df25a2609', 'body': {'volumeAttachment': {'volumeId': 'db775cf2-4493-42ae-b434-4c732475e8af'}}} May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume db775cf2-4493-42ae-b434-4c732475e8af is already attached to instances: d00e4700-28c6-4440-83e4-c3d1a86a75c7 May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:24.475169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume db775cf2-4493-42ae-b434-4c732475e8af is already attached to instances: d00e4700-28c6-4440-83e4-c3d1a86a75c7 May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:24.476661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume db775cf2-4493-42ae-b434-4c732475e8af is already attached to instances: d00e4700-28c6-4440-83e4-c3d1a86a75c7 May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 400 to user: Invalid volume: volume db775cf2-4493-42ae-b434-4c732475e8af is already attached to instances: d00e4700-28c6-4440-83e4-c3d1a86a75c7 {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-af3772ab-52e9-4f08-a005-03ae13c4dddb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103737 May 27 03:27:24.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 297/570] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:27:24 2022] POST /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:27:24.484200 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:24.484698 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.491058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.491506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.492272 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.492712 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.518382 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:27:24.530895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:24.531736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.538729 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.539183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.539988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.540432 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.567920 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:24.601162 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-51b9fde4-4ead-4bda-801e-06648b0754ba tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 204 len: 0 microversion: 2.1 time: 0.120749 May 27 03:27:24.601730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 274/571] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:27:24 2022] DELETE /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:27:24.610174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:24.610871 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:24.616965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.617418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.618218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:24.618656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:24.672375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:24.680081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-042e39f0-ddec-4aeb-b7c1-35e7a7c02e2f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1319 microversion: 2.1 time: 0.153111 May 27 03:27:24.680646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 298/572] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:24 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:24.753078 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:24.761385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-69490207-ecea-4865-9680-f41f3a5651d5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1679 microversion: 2.1 time: 0.155240 May 27 03:27:24.761955 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 275/573] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:24 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:25.699780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:25.700419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:25.710333 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.710780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.711546 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.711985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.779969 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:25.780564 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:25.790369 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.790864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.792047 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:25.792684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:25.848931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:25.856520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d66acab3-91be-41ce-a7f9-5d89a64044b5 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1319 microversion: 2.1 time: 0.163110 May 27 03:27:25.857330 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 299/574] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:25 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:25.930261 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:25.938505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-35a06db8-39f4-41aa-ab63-f3d7de539fd4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1679 microversion: 2.1 time: 0.162439 May 27 03:27:25.939069 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 276/575] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:25 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:26.875647 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:26.876346 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:26.884162 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:26.884584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:26.885405 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:26.886174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:26.956031 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:26.956664 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:26.964462 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:26.964880 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:26.965896 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:26.966380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:27.027349 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:27.035358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d576ec93-87ee-4f80-94a0-d6ba0b18d3a0 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1319 microversion: 2.1 time: 0.164666 May 27 03:27:27.041595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 300/576] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:26 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:27.102698 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:27.110833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7d3b2d50-ec59-4fbe-bf26-6b0eacbf304a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1679 microversion: 2.1 time: 0.158878 May 27 03:27:27.111409 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 277/577] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:26 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:27.707176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-74696916-cdc0-45c0-97ce-4bbdd3abfd7b req-872a09e3-8fc2-4459-9bf9-58bdf5d210fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0360f3b9-e443-4d35-89a4-6f981918f34a", "name": "network-vif-plugged", "status": "completed", "tag": "884547de-07f3-4f0b-bce0-549d72cba67d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:27.716468 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-74696916-cdc0-45c0-97ce-4bbdd3abfd7b req-872a09e3-8fc2-4459-9bf9-58bdf5d210fb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:27.717470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-74696916-cdc0-45c0-97ce-4bbdd3abfd7b req-872a09e3-8fc2-4459-9bf9-58bdf5d210fb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:27.742607 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-74696916-cdc0-45c0-97ce-4bbdd3abfd7b req-872a09e3-8fc2-4459-9bf9-58bdf5d210fb service nova] Creating event network-vif-plugged:884547de-07f3-4f0b-bce0-549d72cba67d for instance 0360f3b9-e443-4d35-89a4-6f981918f34a on hv-cinder-82880 May 27 03:27:27.748048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-74696916-cdc0-45c0-97ce-4bbdd3abfd7b req-872a09e3-8fc2-4459-9bf9-58bdf5d210fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044291 May 27 03:27:27.749466 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 301/578] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:28.053402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:28.054017 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:28.061313 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.061764 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.062546 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.062987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.129719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:28.130430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:28.138098 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.138549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.139361 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.139797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.301551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:28.310375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-78ea451d-b391-45bf-b466-d6ce138b3710 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1679 microversion: 2.1 time: 0.185726 May 27 03:27:28.311231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 302/579] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:28 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:28.315947 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:28.318912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:28.323882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.324416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.325300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.325808 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.351460 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'flavor' on Instance uuid b967195a-9c2e-4f9f-9a09-65a4101b07c8 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:28.480405 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-82255342-4590-4439-b800-cd463e086bbe tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/action" status: 200 len: 32 microversion: 2.1 time: 0.167963 May 27 03:27:28.481301 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 303/580] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:27:28 2022] POST /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:27:28.490373 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:28.491209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:28.497443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.497898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.498667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.499106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.512025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:28.520734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e5f29b04-af59-48fe-8ee1-bca66e9f58bb tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1319 microversion: 2.1 time: 0.471223 May 27 03:27:28.521738 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 278/581] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:28 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:28.646140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:28.654587 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a312b077-6631-408d-a2a7-aef1d14b066f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.168231 May 27 03:27:28.655161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 304/582] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:28 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:28.898840 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-150c92cd-022c-4b1f-9ef1-84d827e5aacc req-304c961a-0b8b-4f98-ae0d-6625232d690d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e20f854-915e-4f4e-8596-b16df25a2609", "name": "network-vif-deleted", "tag": "15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:28.907500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-150c92cd-022c-4b1f-9ef1-84d827e5aacc req-304c961a-0b8b-4f98-ae0d-6625232d690d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:28.908246 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-150c92cd-022c-4b1f-9ef1-84d827e5aacc req-304c961a-0b8b-4f98-ae0d-6625232d690d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:28.950823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-150c92cd-022c-4b1f-9ef1-84d827e5aacc req-304c961a-0b8b-4f98-ae0d-6625232d690d service nova] Creating event network-vif-deleted:15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35 for instance 6e20f854-915e-4f4e-8596-b16df25a2609 on hv-cinder-82880 May 27 03:27:28.961458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-150c92cd-022c-4b1f-9ef1-84d827e5aacc req-304c961a-0b8b-4f98-ae0d-6625232d690d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066640 May 27 03:27:28.962457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 279/583] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:29.330883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:29.332277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:29.339150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.339865 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.340639 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.341143 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.373824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.374404 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.374923 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lazy-loading 'fault' on Instance uuid 6e20f854-915e-4f4e-8596-b16df25a2609 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:29.416270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:29.424503 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aba6194f-931f-4449-815c-68d05d7113b1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 200 len: 1330 microversion: 2.1 time: 0.098597 May 27 03:27:29.429787 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 305/584] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:29 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:29.540102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:29.540685 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:29.548158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.548626 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.550079 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.550520 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.674257 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:29.675182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:29.684255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.684860 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.685761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.686302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.699646 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:29.708030 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e09e371f-05c9-43b0-b667-812fad8f7572 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1507 microversion: 2.1 time: 0.173007 May 27 03:27:29.709265 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 280/585] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:29 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:29.725488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f40fb276-e7be-4337-b683-e404599fe9dd tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7195c62f-1e8c-4ab0-bbbd-0efd63413370", "device": "/dev/sdb"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:29.726680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f40fb276-e7be-4337-b683-e404599fe9dd tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:29.733577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f40fb276-e7be-4337-b683-e404599fe9dd tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.734251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f40fb276-e7be-4337-b683-e404599fe9dd tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.735192 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f40fb276-e7be-4337-b683-e404599fe9dd tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.735728 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f40fb276-e7be-4337-b683-e404599fe9dd tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.808294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:29.822031 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:29.864445 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:29.874285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6f8bde19-5676-4cb0-8d19-a7312c94f5a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.205716 May 27 03:27:29.875952 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 306/586] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:29 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:29.880488 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-c2c47902-a202-405a-99fb-7f94b09f92ba req-8c893d1c-07b0-4b0e-baa2-604da3e23164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e20f854-915e-4f4e-8596-b16df25a2609", "name": "network-vif-unplugged", "status": "completed", "tag": "15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:29.890925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-c2c47902-a202-405a-99fb-7f94b09f92ba req-8c893d1c-07b0-4b0e-baa2-604da3e23164 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:29.891397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-c2c47902-a202-405a-99fb-7f94b09f92ba req-8c893d1c-07b0-4b0e-baa2-604da3e23164 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:29.903732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-c2c47902-a202-405a-99fb-7f94b09f92ba req-8c893d1c-07b0-4b0e-baa2-604da3e23164 service nova] Creating event network-vif-unplugged:15f49aae-9ee3-4bd2-82eb-2e60ca6f0e35 for instance 6e20f854-915e-4f4e-8596-b16df25a2609 on hv-cinder-82880 May 27 03:27:29.909415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-c2c47902-a202-405a-99fb-7f94b09f92ba req-8c893d1c-07b0-4b0e-baa2-604da3e23164 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032206 May 27 03:27:29.910343 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 307/587] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:30.439066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:30.445249 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:30.445943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:30.452339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:30.453063 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:30.454008 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:30.454593 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:30.455520 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f40fb276-e7be-4337-b683-e404599fe9dd tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "POST /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734127 May 27 03:27:30.468768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 281/588] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:27:29 2022] POST /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:30.476056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 HTTP/1.1 May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:27:30.478150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:27:30.479776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '6e20f854-915e-4f4e-8596-b16df25a2609'} May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:30.480646 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:27:30.482007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:30.485883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:30.486938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cecf461c-8259-42d7-9016-1dd1210eebe3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 404 len: 111 microversion: 2.1 time: 0.048844 May 27 03:27:30.487929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 308/589] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:30 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:27:30.497545 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6a5f5878-ba0c-4fb6-bacc-eae9f60f5c00 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '.version_select at 0x7f5e74016670>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:30.534790 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6a5f5878-ba0c-4fb6-bacc-eae9f60f5c00 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429368223" status: 202 len: 0 microversion: 2.1 time: 0.041328 May 27 03:27:30.537090 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 282/590] 10.222.0.50 () {58 vars in 1217 bytes} [Fri May 27 03:27:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429368223 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:27:30.892160 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:30.892880 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:30.900052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:30.900590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:30.901479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:30.902081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:31.050189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:31.059138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-82c51e97-670d-47e7-86e2-2239fa4521df tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.170718 May 27 03:27:31.060410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 309/591] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:30 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:31.300231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:31.301703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:31.309822 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:31.310276 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:31.311063 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:31.311683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:31.399539 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lazy-loading 'services' on Instance uuid d00e4700-28c6-4440-83e4-c3d1a86a75c7 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:31.494115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-52a0ae26-d5ef-4cf9-a5ad-a46403eae178 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments/db775cf2-4493-42ae-b434-4c732475e8af" status: 202 len: 0 microversion: 2.1 time: 0.197441 May 27 03:27:31.494803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 283/592] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:27:31 2022] DELETE /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments/db775cf2-4493-42ae-b434-4c732475e8af => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:31.503917 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d02ba2e0-9683-4e39-8411-4d570210526c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:31.505635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d02ba2e0-9683-4e39-8411-4d570210526c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:31.513627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d02ba2e0-9683-4e39-8411-4d570210526c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:31.514397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d02ba2e0-9683-4e39-8411-4d570210526c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:31.515194 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d02ba2e0-9683-4e39-8411-4d570210526c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:31.515855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d02ba2e0-9683-4e39-8411-4d570210526c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:31.550100 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:31.553308 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d02ba2e0-9683-4e39-8411-4d570210526c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053203 May 27 03:27:31.553872 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 310/593] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:31 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:32.077866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:32.078558 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:32.091181 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.092035 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.092213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.093004 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.276852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:32.287841 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5ad91cb0-b5d6-448d-835f-458cd1d81840 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.214181 May 27 03:27:32.288396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 284/594] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:32 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:32.568653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-267c785b-b474-446f-b304-5020a3cc159e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:32.569821 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-267c785b-b474-446f-b304-5020a3cc159e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:32.581870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-267c785b-b474-446f-b304-5020a3cc159e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.582474 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-267c785b-b474-446f-b304-5020a3cc159e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.583704 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-267c785b-b474-446f-b304-5020a3cc159e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:32.584398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-267c785b-b474-446f-b304-5020a3cc159e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:32.632424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-267c785b-b474-446f-b304-5020a3cc159e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070383 May 27 03:27:32.633443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 311/595] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:32 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:33.308003 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:33.308615 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:33.315498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:33.315971 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:33.316721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:33.317187 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:33.463999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:33.475939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4bb60ea5-965c-4569-ba70-85b86b5ecbc8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.172051 May 27 03:27:33.476531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 285/596] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:33 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:33.648695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-68ef63a6-38a1-4171-8b95-14a6e6d802f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:33.650083 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-68ef63a6-38a1-4171-8b95-14a6e6d802f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:33.659944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68ef63a6-38a1-4171-8b95-14a6e6d802f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:33.660634 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68ef63a6-38a1-4171-8b95-14a6e6d802f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:33.661883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68ef63a6-38a1-4171-8b95-14a6e6d802f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:33.662908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68ef63a6-38a1-4171-8b95-14a6e6d802f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:33.693867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-68ef63a6-38a1-4171-8b95-14a6e6d802f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052245 May 27 03:27:33.694464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 312/597] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:33 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:34.496242 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:34.496925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:34.506511 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:34.507098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:34.508334 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:34.508772 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:34.654427 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:34.662917 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6209a47e-600c-48f1-82cf-5a66d19b91ef tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.172872 May 27 03:27:34.663545 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 286/598] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:34 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:34.705819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5c68df4c-60f5-4e8d-aa0c-f743d5e39b73 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:34.706775 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5c68df4c-60f5-4e8d-aa0c-f743d5e39b73 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:34.714063 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c68df4c-60f5-4e8d-aa0c-f743d5e39b73 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:34.714518 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c68df4c-60f5-4e8d-aa0c-f743d5e39b73 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:34.715288 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c68df4c-60f5-4e8d-aa0c-f743d5e39b73 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:34.715725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c68df4c-60f5-4e8d-aa0c-f743d5e39b73 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:34.746203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5c68df4c-60f5-4e8d-aa0c-f743d5e39b73 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 May 27 03:27:34.747056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 313/599] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:34 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:35.682539 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:35.683379 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:35.692462 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:35.693101 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:35.694116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:35.694950 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:35.758219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0b4776db-7bbc-423a-acfb-ed8c521d5dd3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:35.759124 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0b4776db-7bbc-423a-acfb-ed8c521d5dd3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:35.766544 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4776db-7bbc-423a-acfb-ed8c521d5dd3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:35.767004 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4776db-7bbc-423a-acfb-ed8c521d5dd3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:35.767758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4776db-7bbc-423a-acfb-ed8c521d5dd3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:35.768191 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4776db-7bbc-423a-acfb-ed8c521d5dd3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:35.801250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0b4776db-7bbc-423a-acfb-ed8c521d5dd3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047414 May 27 03:27:35.802043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 314/600] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:35 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:35.839142 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:35.847333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9bc90946-2a7a-4581-94a4-68bd46189827 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.170290 May 27 03:27:35.847912 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 287/601] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:35 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:36.817520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-29a34c2e-2522-402b-9bd4-66a9cb700b14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:36.819050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-29a34c2e-2522-402b-9bd4-66a9cb700b14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:36.830041 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29a34c2e-2522-402b-9bd4-66a9cb700b14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:36.830786 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29a34c2e-2522-402b-9bd4-66a9cb700b14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:36.832037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29a34c2e-2522-402b-9bd4-66a9cb700b14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:36.832762 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29a34c2e-2522-402b-9bd4-66a9cb700b14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:36.864718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:36.865608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:36.866016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-29a34c2e-2522-402b-9bd4-66a9cb700b14 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054986 May 27 03:27:36.867102 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 315/602] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:36 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:36.869399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:36.873295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:36.873751 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:36.874511 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:36.874949 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:37.029455 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:37.037588 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a3cce826-df8f-4e96-aabf-27c168e905ce tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.176725 May 27 03:27:37.038148 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 288/603] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:36 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:37.878362 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-903af9dc-7c9f-4f25-b6d1-37d7f7fd1a97 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:37.879248 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-903af9dc-7c9f-4f25-b6d1-37d7f7fd1a97 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:37.886658 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-903af9dc-7c9f-4f25-b6d1-37d7f7fd1a97 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:37.887114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-903af9dc-7c9f-4f25-b6d1-37d7f7fd1a97 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:37.887886 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-903af9dc-7c9f-4f25-b6d1-37d7f7fd1a97 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:37.888315 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-903af9dc-7c9f-4f25-b6d1-37d7f7fd1a97 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:37.919420 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-903af9dc-7c9f-4f25-b6d1-37d7f7fd1a97 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 May 27 03:27:37.920168 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 316/604] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:37 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:38.055115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:38.055719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:38.062025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:38.062496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:38.063261 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:38.063688 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:38.224395 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:38.234651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-25040a23-e53d-4f1c-8805-7de344359cd1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.183465 May 27 03:27:38.235420 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 289/605] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:38 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:38.931782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e8675ac6-b868-4a74-bcf7-2bca48040b26 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:38.932789 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e8675ac6-b868-4a74-bcf7-2bca48040b26 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:38.940549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e8675ac6-b868-4a74-bcf7-2bca48040b26 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:38.941117 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e8675ac6-b868-4a74-bcf7-2bca48040b26 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:38.941902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e8675ac6-b868-4a74-bcf7-2bca48040b26 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:38.942364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e8675ac6-b868-4a74-bcf7-2bca48040b26 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:38.973588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e8675ac6-b868-4a74-bcf7-2bca48040b26 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045945 May 27 03:27:38.974149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 317/606] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:38 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:39.257685 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:39.258731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:39.270116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:39.270871 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:39.272143 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:39.273108 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:39.406301 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:39.409786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:39.414648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-42a62a5f-5112-4f3f-a591-61d02d52549b tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.163759 May 27 03:27:39.415231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 290/607] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:39 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:39.989543 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8be70918-f6fa-4830-add0-fe5df2ea758b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:39.990942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8be70918-f6fa-4830-add0-fe5df2ea758b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:39.998407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8be70918-f6fa-4830-add0-fe5df2ea758b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:39.998850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8be70918-f6fa-4830-add0-fe5df2ea758b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:39.999613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8be70918-f6fa-4830-add0-fe5df2ea758b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:40.000041 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8be70918-f6fa-4830-add0-fe5df2ea758b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:40.031004 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8be70918-f6fa-4830-add0-fe5df2ea758b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048031 May 27 03:27:40.031595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 318/608] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:39 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:40.437151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:40.438139 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:40.448275 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:40.448717 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:40.449506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:40.449960 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:40.603094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:40.611411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-00b4d632-1240-4f99-90bb-60af3cb438b2 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.182163 May 27 03:27:40.611983 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 291/609] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:40 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:41.045104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-44650110-8d6c-4c93-8631-32531cbc983f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:41.046068 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-44650110-8d6c-4c93-8631-32531cbc983f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:41.052976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44650110-8d6c-4c93-8631-32531cbc983f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:41.053463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44650110-8d6c-4c93-8631-32531cbc983f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:41.054259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44650110-8d6c-4c93-8631-32531cbc983f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:41.054708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44650110-8d6c-4c93-8631-32531cbc983f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:41.085127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-44650110-8d6c-4c93-8631-32531cbc983f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 May 27 03:27:41.085653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 319/610] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:41 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:41.636141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:41.636699 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:41.643518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:41.643965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:41.644727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:41.645205 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:41.797603 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:41.806159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-eec1fe9f-6c34-430c-9886-054ff54bf4a1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.176278 May 27 03:27:41.806776 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 292/611] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:41 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:42.101531 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-308c84ac-8651-44b0-9ed8-498438981c47 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:42.104192 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-308c84ac-8651-44b0-9ed8-498438981c47 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:42.115935 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308c84ac-8651-44b0-9ed8-498438981c47 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.116684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308c84ac-8651-44b0-9ed8-498438981c47 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.117985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308c84ac-8651-44b0-9ed8-498438981c47 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.118869 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308c84ac-8651-44b0-9ed8-498438981c47 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.161054 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-308c84ac-8651-44b0-9ed8-498438981c47 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066262 May 27 03:27:42.161619 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 320/612] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:27:42 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:27:42.228420 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:42.228907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:42.235674 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.236116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.236930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.237421 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.264389 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:27:42.348520 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-80ad1d82-be5a-429d-94f6-f6b71df72d3e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 204 len: 0 microversion: 2.1 time: 0.123852 May 27 03:27:42.352636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 293/613] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:27:42 2022] DELETE /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:27:42.359882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:42.360545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:42.367612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.368192 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.369395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.369867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.512896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:42.520776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2c363e7b-39e7-4881-808a-d74e9019716b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1681 microversion: 2.1 time: 0.166524 May 27 03:27:42.521392 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 321/614] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:42 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:42.827555 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:42.828563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:42.837859 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.838534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.839636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:42.840209 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:42.990516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:43.001566 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a97c12f7-b8a0-4e90-a4ca-0dbbea458e0e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.181363 May 27 03:27:43.002401 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 294/615] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:42 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:43.540048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:43.541393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:43.550041 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:43.550611 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:43.551584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:43.552127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:43.692431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:43.704701 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1f09e56a-8830-42e5-af1e-81abbfc5bf10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1681 microversion: 2.1 time: 0.169658 May 27 03:27:43.705561 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 322/616] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:43 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:44.023909 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:44.024907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:44.036089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:44.036820 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:44.038169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:44.038858 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:44.186729 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:44.198232 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-97699d57-71fd-489d-a538-6b3bf9352747 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.180714 May 27 03:27:44.198817 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 295/617] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:44 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:44.727038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:44.727850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:44.736576 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:44.737260 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:44.738428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:44.739008 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:44.890750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:44.903063 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a45a55f4-c894-49fb-b54e-fcfbd025c9a8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1681 microversion: 2.1 time: 0.180873 May 27 03:27:44.903852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 323/618] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:44 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:45.217292 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:45.217853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:45.224794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.225292 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:45.226060 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.226498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:45.368402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:45.381085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-acddd771-9827-4241-83e9-8e39af7abed8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.167711 May 27 03:27:45.381624 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 296/619] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:45 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:45.927824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:45.928442 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:45.937309 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.937817 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:45.938588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:45.939027 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:46.076148 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:46.084207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-96c47ffb-1e6c-4b7f-ac92-fbaede2759f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1681 microversion: 2.1 time: 0.161224 May 27 03:27:46.084780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 324/620] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:45 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:46.400251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:46.400852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:46.408079 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:46.409253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:46.410064 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:46.410511 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:46.632905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:46.643568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a5cff95c-3d30-4670-844b-1d244b090dc7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.247167 May 27 03:27:46.644255 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 297/621] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:46 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:47.057343 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-110b4f1b-b525-41d5-a6bd-48cf6bba29fd req-9bc0b172-be19-4a1d-b424-cc6dc50004f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d00e4700-28c6-4440-83e4-c3d1a86a75c7", "name": "network-vif-deleted", "tag": "1ad404ad-b415-4130-81fb-67637fa7ba8a"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:47.066878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-110b4f1b-b525-41d5-a6bd-48cf6bba29fd req-9bc0b172-be19-4a1d-b424-cc6dc50004f8 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.067343 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-110b4f1b-b525-41d5-a6bd-48cf6bba29fd req-9bc0b172-be19-4a1d-b424-cc6dc50004f8 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.078901 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-110b4f1b-b525-41d5-a6bd-48cf6bba29fd req-9bc0b172-be19-4a1d-b424-cc6dc50004f8 service nova] Creating event network-vif-deleted:1ad404ad-b415-4130-81fb-67637fa7ba8a for instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 on hv-cinder-82880 May 27 03:27:47.084105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-110b4f1b-b525-41d5-a6bd-48cf6bba29fd req-9bc0b172-be19-4a1d-b424-cc6dc50004f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 May 27 03:27:47.084705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 325/622] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:47.102119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:47.102731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:47.110788 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.111235 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.112046 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.112479 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.184309 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:47.192496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c4d760d7-bf08-4ef4-9d7e-2e8a52cf5e6a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1614 microversion: 2.1 time: 0.094209 May 27 03:27:47.193202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 298/623] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:47 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:47.661372 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:47.662127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:47.670059 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.670556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.671343 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:47.671773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:47.847780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:47.856391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f94b3610-d558-4469-8b0c-3d34e2ea1501 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.199331 May 27 03:27:47.863116 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 326/624] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:47 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:48.210390 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:48.211031 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:48.219405 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.220106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.221301 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.221939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.261755 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.262309 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.263123 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lazy-loading 'fault' on Instance uuid d00e4700-28c6-4440-83e4-c3d1a86a75c7 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:48.313399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:48.321348 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-da092146-a148-456f-8658-3e642aad3c30 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 200 len: 1332 microversion: 2.1 time: 0.115018 May 27 03:27:48.321919 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 299/625] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:48 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:48.875783 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:48.876452 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:48.883207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.883663 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:48.884415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:48.884899 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:49.022022 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:49.030635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f72f1497-39da-4c10-9eb6-cd551699ed82 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1735 microversion: 2.1 time: 0.159834 May 27 03:27:49.031208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 327/626] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:48 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:49.339133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:49.339813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:49.347193 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:49.347651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:49.348458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:49.348899 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:49.362855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 HTTP/1.1 May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:27:49.364544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:27:49.365879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'd00e4700-28c6-4440-83e4-c3d1a86a75c7'} May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:49.366576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:27:49.367671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:27:49.368654 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:49.368654 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-02cbeffb-d598-4c77-9be0-1159b9761449 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 404 len: 111 microversion: 2.1 time: 0.030896 May 27 03:27:49.368654 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 300/627] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:49 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:27:49.375271 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0a3b9175-cb6e-4034-8f76-2a57f39558e9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '.version_select at 0x7f5e741bcaf0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:49.397647 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0a3b9175-cb6e-4034-8f76-2a57f39558e9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998157759" status: 202 len: 0 microversion: 2.1 time: 0.026260 May 27 03:27:49.398186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 328/628] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 03:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998157759 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:50.002499 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:50.003634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:50.010921 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.011366 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.012340 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.012752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.055484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:50.056245 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:50.063995 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.064535 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.065403 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.065922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.074610 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:50.118517 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lazy-loading 'services' on Instance uuid 0360f3b9-e443-4d35-89a4-6f981918f34a {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:50.201379 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3ca19771-2e25-4033-84d0-a271b6f57343 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a/os-volume_attachments/7195c62f-1e8c-4ab0-bbbd-0efd63413370" status: 202 len: 0 microversion: 2.1 time: 0.208531 May 27 03:27:50.202365 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 301/629] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:27:49 2022] DELETE /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a/os-volume_attachments/7195c62f-1e8c-4ab0-bbbd-0efd63413370 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:50.211072 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f5c6f8c4-e620-4468-8d38-109a7dd362a6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: .version_select at 0x7f5e741c1ca0>, body: {"keypair": {"name": "tempest-keypair-1602726710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdpzfkF2fnuFB9g2Jr59U5GythsmqTz4HWx9s0XjR0soHL5Pg9ZCcHPnfLIxfuplO1ES92q91gC11TP4NgRRRKypQUuxv1Thj/QmLUl6UCMxRviXLqrDn0BpWn8KXTJXA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:50.220521 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:50.229139 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0517841c-8453-46be-b701-55670f316d51 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1715 microversion: 2.1 time: 0.179811 May 27 03:27:50.230164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 329/630] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:50 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1715 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:50.239864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-f5c6f8c4-e620-4468-8d38-109a7dd362a6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:27:50.243957 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-f5c6f8c4-e620-4468-8d38-109a7dd362a6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:27:50.281695 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f5c6f8c4-e620-4468-8d38-109a7dd362a6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074876 May 27 03:27:50.287800 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 302/631] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:27:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:50.352392 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:50.353245 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:50.359700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.360152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.360921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.361384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.445777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] HTTP exception thrown: Cannot 'detach_volume' instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 while it is in vm_state rescued May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Request method failure captured: May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments/5881c651-96ab-4b4a-aeca-ee789e8a7e38 HTTP/1.1 May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQvkgP6dheA1HISWpdWxeiMUoVKTOpvwrpfLG-ikSRwPw6Oq6pJowRRCtPYOjlAZkPx6l1XfuLMN1XJmMcVOfiQL4cYiJx5ijWcOp_OLv9lVLF8Xf_ooNsu_C-fVamGPpIZtMPA-zLDtioWYSFm6PMhCcJi0NjCRk6CyajVkFIWqV0 May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:27:50.447407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 468a46d55bd342739b9cd78bcd3a77fc May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:27:50.448667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Cannot 'detach_volume' instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 while it is in vm_state rescued May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'server_id': 'b967195a-9c2e-4f9f-9a09-65a4101b07c8', 'id': '5881c651-96ab-4b4a-aeca-ee789e8a7e38'} May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:50.449338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 while it is in vm_state rescued May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 while it is in vm_state rescued May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:50.450481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Returning 409 to user: Cannot 'detach_volume' instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 while it is in vm_state rescued {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:50.451533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dc66aafd-e1de-4b7c-aa3f-4a903ee06a81 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments/5881c651-96ab-4b4a-aeca-ee789e8a7e38" status: 409 len: 152 microversion: 2.1 time: 0.100511 May 27 03:27:50.451533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 330/632] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:27:50 2022] DELETE /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments/5881c651-96ab-4b4a-aeca-ee789e8a7e38 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 03:27:50.459211 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4c1c6837-63c7-4d45-a570-ef8955546778 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:50.460895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4c1c6837-63c7-4d45-a570-ef8955546778 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:50.471077 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1c6837-63c7-4d45-a570-ef8955546778 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.471523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1c6837-63c7-4d45-a570-ef8955546778 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.472526 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1c6837-63c7-4d45-a570-ef8955546778 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.473094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1c6837-63c7-4d45-a570-ef8955546778 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.545119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4c1c6837-63c7-4d45-a570-ef8955546778 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "POST /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/action" status: 202 len: 0 microversion: 2.1 time: 0.090300 May 27 03:27:50.545981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 303/633] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:27:50 2022] POST /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:27:50.556102 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:50.556700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:50.563555 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.563997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.564753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:50.565207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:50.699680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:50.709145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8b496c76-2e0f-4cfb-9450-bcbc9f3b238e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1723 microversion: 2.1 time: 0.156702 May 27 03:27:50.712864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 331/634] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:50 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:51.340402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:51.341013 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:51.347722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.348181 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.349191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.349827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.383021 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:27:51.422101 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:51.480306 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4edd3651-27bd-400f-8614-df5c8edc8e9e tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 204 len: 0 microversion: 2.1 time: 0.143730 May 27 03:27:51.481158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 304/635] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:27:51 2022] DELETE /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:27:51.490924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:51.491528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:51.500313 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.501098 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.501935 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.502496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.683695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:51.691364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b2a62027-bb75-47fb-8936-79eb6260516f tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1513 microversion: 2.1 time: 0.205679 May 27 03:27:51.691933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 332/636] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:51 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:27:51.727063 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:51.727907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:51.734204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.734599 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.735364 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:51.735808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:51.755502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-708517870", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e861f168-e1a5-4542-8ee4-9759fa17a578"}], "security_groups": [{"name": "tempest-securitygroup--690830040"}], "key_name": "tempest-keypair-1602726710", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:51.854752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] validate_networks() for [('e861f168-e1a5-4542-8ee4-9759fa17a578', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:27:51.870770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:51.879251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-454c9963-b1e0-4be5-bc79-dc862ad2c2b7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1723 microversion: 2.1 time: 0.156412 May 27 03:27:51.879831 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 305/637] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:51 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:52.489046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:27:52.489526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:27:52.489999 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:27:52.490464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:27:52.490786 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:27:52.502404 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.503029 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.503630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.504068 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.522169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:27:52.526503 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:27:52.538650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:27:52.540924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:27:52.589707 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-871d189d-4ebc-48e1-912b-68892d9423e8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.838622 May 27 03:27:52.590330 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 333/638] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:27:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:27:52.601183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7083a785-1bc2-489b-834d-2b8fcc2eb6d3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:52.601782 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7083a785-1bc2-489b-834d-2b8fcc2eb6d3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:52.660487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7083a785-1bc2-489b-834d-2b8fcc2eb6d3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:52.668558 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7083a785-1bc2-489b-834d-2b8fcc2eb6d3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1241 microversion: 2.1 time: 0.070939 May 27 03:27:52.669163 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 306/639] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:52 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:52.708526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:52.709197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:52.716231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.716680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.717825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.718262 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.861924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:52.869842 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-968ac155-25f0-4e37-b1fc-eb35ec1f3057 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1513 microversion: 2.1 time: 0.165184 May 27 03:27:52.870408 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 334/640] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:52 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:52.897260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:52.898002 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:52.903895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.904396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:52.905778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:52.906220 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.042736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:53.051844 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d28dc4b8-d062-4554-bebb-e8c799d447ea tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1723 microversion: 2.1 time: 0.158515 May 27 03:27:53.052413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 307/641] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:52 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:53.690944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:53.691879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:53.702129 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.702582 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.703330 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.703769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.769465 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:53.782131 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3bc79026-e9f2-4ae7-b43f-4c0c89703919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1245 microversion: 2.1 time: 0.097302 May 27 03:27:53.782832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 335/642] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:53 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:53.890884 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:53.891672 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:53.901644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.902373 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:53.903621 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:53.904341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.041669 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:54.051683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d0cc003a-2687-4906-a2d7-1830a31abd55 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1513 microversion: 2.1 time: 0.167689 May 27 03:27:54.052275 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 308/643] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:53 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:54.075044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:54.075659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:54.081822 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.082277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.083076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.083519 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.224729 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:54.236126 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6bc29b7a-2aa6-4d67-8964-8de8f4f01bc1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1723 microversion: 2.1 time: 0.164995 May 27 03:27:54.236637 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 336/644] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:54 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:54.346418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-33691ef9-c8c6-487e-b7d6-cfd8427d1945 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:54.346949 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-33691ef9-c8c6-487e-b7d6-cfd8427d1945 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:54.353508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33691ef9-c8c6-487e-b7d6-cfd8427d1945 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.353958 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33691ef9-c8c6-487e-b7d6-cfd8427d1945 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.354757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33691ef9-c8c6-487e-b7d6-cfd8427d1945 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.355206 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-33691ef9-c8c6-487e-b7d6-cfd8427d1945 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.388408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-33691ef9-c8c6-487e-b7d6-cfd8427d1945 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments/03cef2d7-a673-4154-8dee-6bd6fa1315f8" status: 200 len: 194 microversion: 2.20 time: 0.046417 May 27 03:27:54.389012 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 309/645] 10.222.0.50 () {60 vars in 1453 bytes} [Fri May 27 03:27:54 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments/03cef2d7-a673-4154-8dee-6bd6fa1315f8 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:54.464141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:54.464624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:54.466544 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:54.472164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.472629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.473425 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.473856 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.563361 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lazy-loading 'services' on Instance uuid b54917ef-d32c-4303-99e3-75adc12f147e {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:54.645463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ff05cbb5-6bfc-4c5c-817d-7c7cdb3a611c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments/03cef2d7-a673-4154-8dee-6bd6fa1315f8" status: 202 len: 0 microversion: 2.20 time: 0.185117 May 27 03:27:54.646040 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 337/646] 10.222.0.50 () {60 vars in 1456 bytes} [Fri May 27 03:27:54 2022] DELETE /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments/03cef2d7-a673-4154-8dee-6bd6fa1315f8 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:27:54.654444 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d3f66a2b-14c6-4dcc-89fa-2839fe247913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:54.655608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d3f66a2b-14c6-4dcc-89fa-2839fe247913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:54.661870 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3f66a2b-14c6-4dcc-89fa-2839fe247913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.662320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3f66a2b-14c6-4dcc-89fa-2839fe247913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.663080 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3f66a2b-14c6-4dcc-89fa-2839fe247913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.663529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3f66a2b-14c6-4dcc-89fa-2839fe247913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.693756 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d3f66a2b-14c6-4dcc-89fa-2839fe247913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042911 May 27 03:27:54.694482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 310/647] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 03:27:54 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:54.806014 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:54.806600 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:54.813961 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.814415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.815234 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:54.815697 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:54.887197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:54.895099 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2a3c6d52-a04e-4fc5-b755-cb4133cbebe2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1237 microversion: 2.1 time: 0.094074 May 27 03:27:54.895664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 338/648] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:54 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:55.073335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:55.074203 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:55.082206 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.082664 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.083429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.083866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.252994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:55.253718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:55.260272 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.260762 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.261714 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.262245 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.268639 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:55.278837 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fe78a294-cec4-4c31-bbe5-1485487f9bf1 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1513 microversion: 2.1 time: 0.212056 May 27 03:27:55.279458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 311/649] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:55 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:55.390750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:55.398828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7e6e7367-fbf0-4b34-ad04-dc6d7a5d8e0a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1729 microversion: 2.1 time: 0.150035 May 27 03:27:55.399395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 339/650] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:55 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:55.415575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0a3cd42b-e1cc-405d-932d-c070e8b10a1a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:55.416067 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0a3cd42b-e1cc-405d-932d-c070e8b10a1a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:55.422366 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a3cd42b-e1cc-405d-932d-c070e8b10a1a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.422815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a3cd42b-e1cc-405d-932d-c070e8b10a1a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.423594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a3cd42b-e1cc-405d-932d-c070e8b10a1a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.424032 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a3cd42b-e1cc-405d-932d-c070e8b10a1a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.500206 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0a3cd42b-e1cc-405d-932d-c070e8b10a1a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088435 May 27 03:27:55.500803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 312/651] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:27:55 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:27:55.706846 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0cf86eab-2ed5-44f4-b935-09e9601423f4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:55.707925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0cf86eab-2ed5-44f4-b935-09e9601423f4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:55.714968 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0cf86eab-2ed5-44f4-b935-09e9601423f4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.715471 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0cf86eab-2ed5-44f4-b935-09e9601423f4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.716288 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0cf86eab-2ed5-44f4-b935-09e9601423f4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.716728 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0cf86eab-2ed5-44f4-b935-09e9601423f4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.749363 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0cf86eab-2ed5-44f4-b935-09e9601423f4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046862 May 27 03:27:55.749952 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 340/652] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 03:27:55 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:55.912081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:55.912783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:55.918981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.919527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.920268 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:55.920819 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:55.984999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:55.992635 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3f6ebd41-2001-46e3-8fae-3a521d0b04e6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1293 microversion: 2.1 time: 0.084562 May 27 03:27:55.993238 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 313/653] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:55 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:56.296669 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:56.298536 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:56.306436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:56.306886 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:56.307693 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:56.308133 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:56.465641 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:56.468709 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-21556af5-c6c1-46db-b7c0-f4e661bba7bb req-a1479419-9c84-444c-bf1d-91965727b31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b967195a-9c2e-4f9f-9a09-65a4101b07c8", "tag": "00901745-e24d-4624-8550-b70ca512f20a"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:56.482056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-feee3cb9-8701-4ad6-989a-16e93aa41919 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1471 microversion: 2.1 time: 0.189910 May 27 03:27:56.483100 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 341/654] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:56 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:56.494213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-21556af5-c6c1-46db-b7c0-f4e661bba7bb req-a1479419-9c84-444c-bf1d-91965727b31a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:56.494748 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-21556af5-c6c1-46db-b7c0-f4e661bba7bb req-a1479419-9c84-444c-bf1d-91965727b31a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:56.524349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-21556af5-c6c1-46db-b7c0-f4e661bba7bb req-a1479419-9c84-444c-bf1d-91965727b31a service nova] Creating event network-changed:00901745-e24d-4624-8550-b70ca512f20a for instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 on hv-cinder-82880 May 27 03:27:56.530451 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-21556af5-c6c1-46db-b7c0-f4e661bba7bb req-a1479419-9c84-444c-bf1d-91965727b31a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065968 May 27 03:27:56.532119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 314/655] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:56.761818 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e966d3ba-9880-44f1-9787-0794b2f02599 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:56.763178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e966d3ba-9880-44f1-9787-0794b2f02599 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:56.773534 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e966d3ba-9880-44f1-9787-0794b2f02599 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:56.776940 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e966d3ba-9880-44f1-9787-0794b2f02599 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:56.778015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e966d3ba-9880-44f1-9787-0794b2f02599 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:56.780472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e966d3ba-9880-44f1-9787-0794b2f02599 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:56.834219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-01400b54-05b6-44db-9d7e-59ff50173e7e req-6a88b1b6-8daf-4514-9fc3-a7d6c38021ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0360f3b9-e443-4d35-89a4-6f981918f34a", "name": "network-vif-deleted", "tag": "884547de-07f3-4f0b-bce0-549d72cba67d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:56.848699 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-01400b54-05b6-44db-9d7e-59ff50173e7e req-6a88b1b6-8daf-4514-9fc3-a7d6c38021ee service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:56.849183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-01400b54-05b6-44db-9d7e-59ff50173e7e req-6a88b1b6-8daf-4514-9fc3-a7d6c38021ee service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:56.855773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e966d3ba-9880-44f1-9787-0794b2f02599 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098505 May 27 03:27:56.864071 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 342/656] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 03:27:56 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:27:56.906316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-01400b54-05b6-44db-9d7e-59ff50173e7e req-6a88b1b6-8daf-4514-9fc3-a7d6c38021ee service nova] Creating event network-vif-deleted:884547de-07f3-4f0b-bce0-549d72cba67d for instance 0360f3b9-e443-4d35-89a4-6f981918f34a on hv-cinder-82880 May 27 03:27:56.924445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-01400b54-05b6-44db-9d7e-59ff50173e7e req-6a88b1b6-8daf-4514-9fc3-a7d6c38021ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091151 May 27 03:27:56.926750 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 315/657] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:27:57.009341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:57.010667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:57.019846 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.020753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.021844 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.022500 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.103088 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:57.111643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-85452c5b-05df-4626-90da-060dc37cf5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1299 microversion: 2.1 time: 0.106070 May 27 03:27:57.112448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 343/658] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:57 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:57.500412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:57.502045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:57.516011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.516467 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.517243 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.518504 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.607141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.609424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.610220 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lazy-loading 'fault' on Instance uuid 0360f3b9-e443-4d35-89a4-6f981918f34a {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:27:57.677967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbd32e5751496e8eaaf3bd03d8f833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4052d211d2a346d8be95d6ac7761defb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:57.687838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b5f03f29-52e8-4b66-9eab-686fe98fa09c tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 200 len: 1309 microversion: 2.1 time: 0.192141 May 27 03:27:57.691195 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 316/659] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:57 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 1309 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:57.879165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-28d64085-9f08-4b2d-8ee3-eaf03ab29bae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:57.880109 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-28d64085-9f08-4b2d-8ee3-eaf03ab29bae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:57.890108 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28d64085-9f08-4b2d-8ee3-eaf03ab29bae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.891053 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28d64085-9f08-4b2d-8ee3-eaf03ab29bae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.891837 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28d64085-9f08-4b2d-8ee3-eaf03ab29bae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.892273 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-28d64085-9f08-4b2d-8ee3-eaf03ab29bae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.929631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-28d64085-9f08-4b2d-8ee3-eaf03ab29bae tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057409 May 27 03:27:57.930210 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 344/660] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 03:27:57 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:57.987994 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:57.988527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:57.994513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.994970 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:57.995734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:57.996175 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.021345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:27:58.120230 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a5790bee-721b-4bd6-9dee-c049a971c94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 204 len: 0 microversion: 2.20 time: 0.135749 May 27 03:27:58.126022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 317/661] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 03:27:57 2022] DELETE /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:27:58.129220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:58.130016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:58.132433 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:58.133170 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:58.138608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.140163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.140326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.140663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.141469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.141652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.142106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.142675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.300676 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:58.308710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:58.310347 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:58.311811 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8b2b1343-3a8b-4a1e-8fc4-f51dbb567e36 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.183905 May 27 03:27:58.323684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 318/662] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:58 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:58.378451 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:58.381025 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:27:58.389979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-318e561d-c3c7-4c32-8839-69f6bd7c7265 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.265242 May 27 03:27:58.390708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 345/663] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:58 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:27:58.546942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-6599dce0-07f9-461e-b70f-89736ba66e4c req-00cbca66-4053-43f6-979d-4a17e0ebe7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b967195a-9c2e-4f9f-9a09-65a4101b07c8", "tag": "00901745-e24d-4624-8550-b70ca512f20a"}, {"name": "network-changed", "server_uuid": "9d25eaff-39bb-4434-848b-7b2dcc68d1e9", "tag": "7548807f-da0a-4e25-9317-457dbf196bc6"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:27:58.557525 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6599dce0-07f9-461e-b70f-89736ba66e4c req-00cbca66-4053-43f6-979d-4a17e0ebe7b3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.557945 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6599dce0-07f9-461e-b70f-89736ba66e4c req-00cbca66-4053-43f6-979d-4a17e0ebe7b3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.573009 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-6599dce0-07f9-461e-b70f-89736ba66e4c req-00cbca66-4053-43f6-979d-4a17e0ebe7b3 service nova] Creating event network-changed:00901745-e24d-4624-8550-b70ca512f20a for instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 on hv-cinder-82880 May 27 03:27:58.573461 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-6599dce0-07f9-461e-b70f-89736ba66e4c req-00cbca66-4053-43f6-979d-4a17e0ebe7b3 service nova] Creating event network-changed:7548807f-da0a-4e25-9317-457dbf196bc6 for instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 on hv-cinder-82880 May 27 03:27:58.580181 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-6599dce0-07f9-461e-b70f-89736ba66e4c req-00cbca66-4053-43f6-979d-4a17e0ebe7b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037336 May 27 03:27:58.580783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 319/664] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:27:58.706744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:58.707510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] [instance: 0360f3b9-e443-4d35-89a4-6f981918f34a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:58.713992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.714433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.715181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:58.715609 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:58.729729 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] HTTP exception thrown: Instance 0360f3b9-e443-4d35-89a4-6f981918f34a could not be found. May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Request method failure captured: May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a HTTP/1.1 May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikESs7J1AlwkO9rDu3hpbYxu9Z-8VDRqeOEEnCbWsN31u3HDdGjVx9RrfBrbpDl6w7gKf9OTtsAb9U7nQckgSePPaQjJI2NXqs2NbLRI2rAYqhb-c6yuAUa4uySB25Y5tZ1S_Y4l-ECwO3_yL4uLvclK1GGe-4G8ygLqMs_EJroaKZvU May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 4052d211d2a346d8be95d6ac7761defb May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1582536527 May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:27:58.731406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4052d211d2a346d8be95d6ac7761defb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesSnapshotTestJSON-1582536527 May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 4052d211d2a346d8be95d6ac7761defb May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1582536527 May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesSnapshotTestJSON-1582536527-project May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: f0fbd32e5751496e8eaaf3bd03d8f833 May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesSnapshotTestJSON-1582536527-project May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 0360f3b9-e443-4d35-89a4-6f981918f34a could not be found. May 27 03:27:58.733076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '0360f3b9-e443-4d35-89a4-6f981918f34a'} May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0360f3b9-e443-4d35-89a4-6f981918f34a could not be found. May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:27:58.733853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0360f3b9-e443-4d35-89a4-6f981918f34a could not be found. May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0360f3b9-e443-4d35-89a4-6f981918f34a could not be found. May 27 03:27:58.735056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:27:58.736106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] Returning 404 to user: Instance 0360f3b9-e443-4d35-89a4-6f981918f34a could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:27:58.736106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-755c7bcb-9a91-492b-857f-6a581764a0a7 tempest-VolumesSnapshotTestJSON-1582536527 tempest-VolumesSnapshotTestJSON-1582536527-project] 10.222.0.50 "GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a" status: 404 len: 111 microversion: 2.1 time: 0.029982 May 27 03:27:58.736106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 346/665] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:58 2022] GET /compute/v2.1/servers/0360f3b9-e443-4d35-89a4-6f981918f34a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:27:59.331622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:59.332312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:59.339345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:59.339790 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:59.340557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:59.340991 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:59.406958 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:27:59.407567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:27:59.414561 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:59.415028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:59.416002 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:27:59.416567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:27:59.486962 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:59.495163 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:59.496641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:59.497822 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fbc438a6-3a05-467d-8914-7448fc4d8132 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.170870 May 27 03:27:59.498407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 320/666] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:27:59 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:27:59.553590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:27:59.565480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0ed0f2c9-e97a-48f6-bf83-7b54094f6b2a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.162163 May 27 03:27:59.566355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 347/667] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:27:59 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:00.516569 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:00.517217 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:00.519832 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:00.525761 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:00.526219 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:00.527000 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:00.527428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:00.587137 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:00.587735 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:00.594630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:00.595189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:00.595961 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:00.596398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:00.732989 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:00.740981 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-def1cafb-6175-4b75-8231-bee9bc6e9bcc tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.157789 May 27 03:28:00.741595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 348/668] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:00 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:00.784054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:00.788334 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:00.794223 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:00.796535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:00.797734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-80ad82a9-3beb-4bdf-8922-fcd228408833 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1724 microversion: 2.20 time: 0.285419 May 27 03:28:00.798299 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 321/669] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:00 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:01.167812 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-6800f8d9-26f1-45c9-b181-8a6b91176418 req-4ce3c5c0-22cf-4b21-87be-38432758a845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54917ef-d32c-4303-99e3-75adc12f147e", "name": "network-vif-deleted", "tag": "fe4197df-049a-453f-a110-e4a007e15f18"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:01.177290 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-6800f8d9-26f1-45c9-b181-8a6b91176418 req-4ce3c5c0-22cf-4b21-87be-38432758a845 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:01.177758 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-6800f8d9-26f1-45c9-b181-8a6b91176418 req-4ce3c5c0-22cf-4b21-87be-38432758a845 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:01.189176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-6800f8d9-26f1-45c9-b181-8a6b91176418 req-4ce3c5c0-22cf-4b21-87be-38432758a845 service nova] Creating event network-vif-deleted:fe4197df-049a-453f-a110-e4a007e15f18 for instance b54917ef-d32c-4303-99e3-75adc12f147e on hv-cinder-82880 May 27 03:28:01.193970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-6800f8d9-26f1-45c9-b181-8a6b91176418 req-4ce3c5c0-22cf-4b21-87be-38432758a845 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029913 May 27 03:28:01.194561 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 349/670] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:01.759185 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:01.760097 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:01.769374 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:01.769823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:01.770594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:01.771027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:01.822600 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:01.822600 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:01.829753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:01.830213 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:01.830995 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:01.831436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:01.898279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:01.906723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:01.908206 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:01.909377 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d3eba9cb-0c98-48d5-96d8-0dbc92c4b738 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1656 microversion: 2.20 time: 0.092299 May 27 03:28:01.909938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 350/671] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:01 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:28:01.916886 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:01.924786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cf5a554c-9961-4043-86fd-a8fa8e1b19e0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.169898 May 27 03:28:01.925482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 322/672] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:01 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:02.929095 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:02.929745 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:02.931727 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:02.932503 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:02.940838 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:02.941440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:02.942226 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:02.942670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:02.942932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:02.943741 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:02.945929 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:02.952363 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:02.952819 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:02.953637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:02.954076 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:03.009983 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:03.018341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:03.019842 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:03.021028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0fbd4d87-1879-4619-bd13-024d91a9ed0f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1656 microversion: 2.20 time: 0.096702 May 27 03:28:03.021604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 351/673] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:02 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1656 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:03.088011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:03.096155 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4fffddb7-6f9b-41ad-8a55-efa7739bf5dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.157916 May 27 03:28:03.096758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 323/674] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:02 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:04.040097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:04.040722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:04.048211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:04.048655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:04.049438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:04.049884 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:04.114918 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:04.115511 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:04.122089 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:04.122705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:04.123158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:04.123942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:04.124404 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:04.130824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:04.132325 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:04.133501 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f3a6b585-2978-4461-8586-62beb71ef94d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 200 len: 1367 microversion: 2.20 time: 0.097727 May 27 03:28:04.134064 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 352/675] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:04 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:04.351367 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:04.359238 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-353064eb-cac9-4eee-bf46-a82534079784 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.248231 May 27 03:28:04.359892 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 324/676] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:04 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:05.152248 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:05.152866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:05.160309 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.160763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:05.161595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.162050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:05.178518 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] HTTP exception thrown: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Request method failure captured: May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e HTTP/1.1 May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ5bYeg-FJOD-wolyZgCmo6FaNsAXCY0IzoXQXEmFCMoakMYypeBU7eMvNfiNRl3J80WtRraj9PCDIJaV4n7zflP6uES5vhEscJfW-_LKamKCeKz0D4jP_LpT07GMkGGlYTz8bNwM7ZNzI5RAdRVSnymxRfCGrMxOpKR6XnHbemOOQ May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:28:05.180202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: dd9938d83dc84ae494310741e2cba2ec May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:28:05.181710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'b54917ef-d32c-4303-99e3-75adc12f147e'} May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:05.182486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:28:05.183750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:05.184965 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Returning 404 to user: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:05.184965 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-993e461b-04c6-412d-a780-55f69aa36a21 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 404 len: 111 microversion: 2.20 time: 0.034055 May 27 03:28:05.184965 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 353/677] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:05 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:28:05.191933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8dc08fb0-d085-4816-b6ea-77ea580adc34 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '.version_select at 0x7f5e7413cd30>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:05.213057 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8dc08fb0-d085-4816-b6ea-77ea580adc34 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744236539" status: 204 len: 0 microversion: 2.20 time: 0.025405 May 27 03:28:05.213790 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 325/678] 10.222.0.50 () {60 vars in 1261 bytes} [Fri May 27 03:28:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744236539 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 03:28:05.378077 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:05.378683 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:05.393461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.394328 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:05.395325 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.395772 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:05.631402 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:05.639692 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bd4bdd23-3435-47e4-b43e-11ac4d58f30e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.267830 May 27 03:28:05.640622 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 354/679] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:05 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:05.932629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fdf4c000-c5bb-47bb-b746-80305cf42531 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'create', calling method: .version_select at 0x7f5e6f7fd160>, body: {"keypair": {"name": "tempest-keypair-1422746929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGomV8uYU/unER/S1/NRE0FQIMXctRv2M2YzWPLKaRUzveLaQ5sBqsFpKw7pYWk4pKp68OHCT5T7JhRGbDQ8DHY1CRZIrS5zyDANRd/KkEliiowdZsAskpoT+n9gA2dW3w=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:05.947100 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fdf4c000-c5bb-47bb-b746-80305cf42531 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:05.950948 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fdf4c000-c5bb-47bb-b746-80305cf42531 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for user dd9938d83dc84ae494310741e2cba2ec and project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:05.984516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fdf4c000-c5bb-47bb-b746-80305cf42531 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056444 May 27 03:28:05.985271 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 326/680] 10.222.0.50 () {62 vars in 1199 bytes} [Fri May 27 03:28:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 03:28:05.987929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-96dd177b-2cbe-4f84-9357-e09ff7ada53e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:05.988894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-96dd177b-2cbe-4f84-9357-e09ff7ada53e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:05.995118 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96dd177b-2cbe-4f84-9357-e09ff7ada53e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.995743 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96dd177b-2cbe-4f84-9357-e09ff7ada53e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:05.996513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96dd177b-2cbe-4f84-9357-e09ff7ada53e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:05.996963 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96dd177b-2cbe-4f84-9357-e09ff7ada53e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.030321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-96dd177b-2cbe-4f84-9357-e09ff7ada53e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046561 May 27 03:28:06.031298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 355/681] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:28:05 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:28:06.100889 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:06.101707 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:06.110290 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.111214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.112380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.113055 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.141885 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:28:06.233405 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3e111a69-a31b-4730-a98a-9b07cef490a2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 204 len: 0 microversion: 2.1 time: 0.139220 May 27 03:28:06.238711 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 327/682] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:28:06 2022] DELETE /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:28:06.244662 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:06.245853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:06.253879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.254645 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.255434 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.256049 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.431760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:06.439561 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-20c7f5e1-0e98-40a7-94de-bf105b84000c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1673 microversion: 2.1 time: 0.199381 May 27 03:28:06.440212 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 356/683] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:06 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:06.658362 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:06.658964 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:06.665065 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.665728 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.666748 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:06.667410 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:06.811931 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:06.821833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3346fb48-fc80-4c1a-8f18-d1a1906c1915 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.167948 May 27 03:28:06.823107 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 328/684] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:06 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:07.301414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-a9759aa2-f74d-4f68-90bc-1762cfbd0237 req-412e85a2-06c9-43f8-8709-6b2b01b48203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d25eaff-39bb-4434-848b-7b2dcc68d1e9", "name": "network-vif-plugged", "status": "completed", "tag": "7548807f-da0a-4e25-9317-457dbf196bc6"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:07.310964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a9759aa2-f74d-4f68-90bc-1762cfbd0237 req-412e85a2-06c9-43f8-8709-6b2b01b48203 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:07.311390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a9759aa2-f74d-4f68-90bc-1762cfbd0237 req-412e85a2-06c9-43f8-8709-6b2b01b48203 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.324442 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-a9759aa2-f74d-4f68-90bc-1762cfbd0237 req-412e85a2-06c9-43f8-8709-6b2b01b48203 service nova] Creating event network-vif-plugged:7548807f-da0a-4e25-9317-457dbf196bc6 for instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 on hv-cinder-82880 May 27 03:28:07.331052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-a9759aa2-f74d-4f68-90bc-1762cfbd0237 req-412e85a2-06c9-43f8-8709-6b2b01b48203 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039336 May 27 03:28:07.331970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 357/685] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:07.457818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:07.458400 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:07.465609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:07.466059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.466829 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:07.467266 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.643304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:07.651154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6c206d46-43c6-498b-b3f8-c3b968f13c05 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1673 microversion: 2.1 time: 0.197610 May 27 03:28:07.651712 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 329/686] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:07 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:07.695902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-21095739", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9235750b-3863-4242-97a7-a4cb52643ca2"}], "security_groups": [{"name": "tempest-securitygroup--570300709"}], "key_name": "tempest-keypair-1422746929", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:07.803713 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] validate_networks() for [('9235750b-3863-4242-97a7-a4cb52643ca2', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:28:07.840215 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:07.840998 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:07.847629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:07.848078 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.848841 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:07.849308 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:07.979119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:07.987328 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-31f1105b-60a3-4e7c-a963-c893676621cf tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.150998 May 27 03:28:07.987908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 330/687] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:07 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:08.185813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:28:08.186552 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:28:08.187233 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:28:08.187680 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:28:08.188095 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:28:08.197782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.198228 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.199020 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.199454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.216469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:08.221085 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Getting quotas for user dd9938d83dc84ae494310741e2cba2ec and project 7e2e4b63d6af43058e0dc76d8ceac844. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:08.233097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:28:08.235630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:28:08.287677 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cd09294b-b57c-4131-8f45-39da48091520 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.596437 May 27 03:28:08.288328 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 358/688] 10.222.0.50 () {62 vars in 1187 bytes} [Fri May 27 03:28:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 27 03:28:08.299035 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f9def3ce-d584-4a73-9fdf-5f55ceb82e8b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:08.299640 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f9def3ce-d584-4a73-9fdf-5f55ceb82e8b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:08.355802 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f9def3ce-d584-4a73-9fdf-5f55ceb82e8b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:08.363257 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f9def3ce-d584-4a73-9fdf-5f55ceb82e8b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:08.364767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f9def3ce-d584-4a73-9fdf-5f55ceb82e8b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:08.365945 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f9def3ce-d584-4a73-9fdf-5f55ceb82e8b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1280 microversion: 2.20 time: 0.071069 May 27 03:28:08.366758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 331/689] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:08 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:08.669472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:08.670078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:08.676893 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.677378 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.678137 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:08.678654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:08.819337 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:08.827231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eef87589-f3ea-493b-aeca-e44dc77c0c51 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1673 microversion: 2.1 time: 0.162215 May 27 03:28:08.827798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 359/690] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:08 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:09.009229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:09.010505 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:09.021876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.022628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.023956 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.024691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.163096 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:09.170764 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e617003c-cc38-4822-a7cc-fce87fd9c95e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.168321 May 27 03:28:09.171330 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 332/691] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:09 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:09.388673 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:09.389728 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:09.396297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.396753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.397541 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.397984 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.467336 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:09.475797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:09.477339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:09.478446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-272ae164-e269-4e2d-bd0e-21c2b26e5abe tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1284 microversion: 2.20 time: 0.096779 May 27 03:28:09.479010 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 360/692] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:09 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:09.847666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:09.848543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:09.856938 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.857589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.858659 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:09.859577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:09.996931 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:10.008730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-eaadcae3-db3e-4f36-8e50-fb749e5aa558 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1673 microversion: 2.1 time: 0.167085 May 27 03:28:10.009930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 333/693] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:09 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:10.188354 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.188979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:10.195876 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.196356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.197169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.197608 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.332493 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:10.340484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d55470bd-aa67-4fac-8caf-4e23796be6f0 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.156087 May 27 03:28:10.341079 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 361/694] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:10.501540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:10.502184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:10.509125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.509922 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.510692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:10.511204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:10.581749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:10.594461 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:10.597111 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f4333069-7f5d-47ca-9fd0-f09a1ae6c45b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1284 microversion: 2.20 time: 0.100882 May 27 03:28:10.597666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 334/695] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:10 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:11.029458 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.030063 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:11.036384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.036825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.037616 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.038081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.186802 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:11.196741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6d1d44f3-bf57-47fa-b05d-97a51c9ae59b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1673 microversion: 2.1 time: 0.171255 May 27 03:28:11.197440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 362/696] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:11.358530 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.359172 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:11.366712 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.367158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.367917 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.368346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.527869 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:11.535513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-aaf77c3f-d1f1-4085-b11d-92924910319c tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.181379 May 27 03:28:11.536081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 335/697] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:11.619913 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:11.620514 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:11.627120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.627559 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.628325 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:11.628760 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:11.693866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:11.702184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:11.704412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:11.705567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2dc56415-c188-4632-b9c9-e2631969c400 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1332 microversion: 2.20 time: 0.089640 May 27 03:28:11.706197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 363/698] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:11 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:12.214533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.215169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:12.221606 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.222059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:12.222832 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.223247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:12.493296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:12.502726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e3522c4a-b44f-4e72-87f9-bf15cab00d35 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1673 microversion: 2.1 time: 0.292155 May 27 03:28:12.504121 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 336/699] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1673 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:12.553209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.554479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:12.561988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.562385 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:12.563328 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.564237 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:12.702668 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:12.711087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8e9b70b0-0044-45fd-a9a3-06f463d2a272 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1366 microversion: 2.1 time: 0.162217 May 27 03:28:12.711732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 364/700] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:12.724126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:12.724855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:12.732148 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.732675 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:12.733550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:12.734048 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:13.232341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:13.241888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:13.243329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:13.244444 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-999b375e-e17d-42be-82ec-38611aefc7e4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1338 microversion: 2.20 time: 0.524609 May 27 03:28:13.245119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 337/701] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:12 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1338 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:28:13.291752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-63d7fc61-39df-4c97-bf75-9161a694ae83 req-02802ea1-ed6f-4e6f-8f07-031990336ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04444dd-f9dd-428f-b524-fba73fc83fe4", "name": "network-vif-deleted", "tag": "bfbe9cb8-2655-4fd9-8904-baffc1034ee0"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:13.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-63d7fc61-39df-4c97-bf75-9161a694ae83 req-02802ea1-ed6f-4e6f-8f07-031990336ff1 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:13.301027 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-63d7fc61-39df-4c97-bf75-9161a694ae83 req-02802ea1-ed6f-4e6f-8f07-031990336ff1 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:13.314297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-63d7fc61-39df-4c97-bf75-9161a694ae83 req-02802ea1-ed6f-4e6f-8f07-031990336ff1 service nova] Creating event network-vif-deleted:bfbe9cb8-2655-4fd9-8904-baffc1034ee0 for instance a04444dd-f9dd-428f-b524-fba73fc83fe4 on hv-cinder-82880 May 27 03:28:13.320368 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-63d7fc61-39df-4c97-bf75-9161a694ae83 req-02802ea1-ed6f-4e6f-8f07-031990336ff1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032212 May 27 03:28:13.321007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 365/702] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:13.521710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:13.522277 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:13.529358 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:13.529829 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:13.530598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:13.531100 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:13.608745 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:13.617109 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1f9f8e65-76e7-4985-9ce7-1bdea187cd88 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1605 microversion: 2.1 time: 0.099399 May 27 03:28:13.617696 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 338/703] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:13 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1605 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:13.732938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:13.733969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:13.742725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:13.743240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:13.744077 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:13.744575 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:13.760651 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:13.963623 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:13.979904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-adcfa8bb-4236-49b3-b590-a1267ccab8e1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1557 microversion: 2.1 time: 0.254086 May 27 03:28:13.984190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 366/704] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:13 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1557 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:13.996810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-359d0023-67cb-4649-8248-31250cb4f069 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:13.997329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-359d0023-67cb-4649-8248-31250cb4f069 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:14.005803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-359d0023-67cb-4649-8248-31250cb4f069 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.007949 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-359d0023-67cb-4649-8248-31250cb4f069 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.010191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-359d0023-67cb-4649-8248-31250cb4f069 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.011647 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-359d0023-67cb-4649-8248-31250cb4f069 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.113314 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-359d0023-67cb-4649-8248-31250cb4f069 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120456 May 27 03:28:14.113911 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 339/705] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:28:13 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:28:14.263740 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:14.264633 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:14.272009 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.272469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.273274 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.273715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.448225 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:14.469117 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:14.470975 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:14.472176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c29896ee-e5d9-4935-bbc0-7940c8788586 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.213504 May 27 03:28:14.472787 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 367/706] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:14 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:14.635636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:14.636188 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:14.642793 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.643247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.644172 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.644638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.649106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:14.690598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:14.691210 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:14.691673 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lazy-loading 'fault' on Instance uuid a04444dd-f9dd-428f-b524-fba73fc83fe4 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:14.769993 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:14.776678 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e5844480-940d-46e2-9d7f-965e1b4bb62e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 200 len: 1327 microversion: 2.1 time: 0.146067 May 27 03:28:14.777283 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 340/707] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:14 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:15.490009 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:15.490655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:15.497695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.498149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.498920 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.499359 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.642553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:15.650873 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:15.652777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:15.654266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2a3497a6-5a55-4d11-b251-b36791140ee7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.168279 May 27 03:28:15.655038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 368/708] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:15 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:15.795215 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:15.795892 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:15.802779 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.803231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.804020 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:15.804464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:15.819966 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] HTTP exception thrown: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Request method failure captured: May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 HTTP/1.1 May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ26TzgXMf-PIZBOfXf3Ml4boeCdzMCVXiqu2IrGO3Njfnl1PjiaZluW1bdTjnqDxUqBDWxsNC3S5NL3szWirtg_dKPjSK_GTvSGQ-cbT1EOcANsq4hsbih4VU4Ny31WKRhgk4Lvopc-VYRDEkYK8_ucoddxBvT_48niP_C-mvbVBU May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:28:15.821736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeTestJSON-1734808862 May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 19457c759f0b4f5cbc530364af1f47d7 May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:28:15.823115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'a04444dd-f9dd-428f-b524-fba73fc83fe4'} May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:15.823852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:28:15.825169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:15.826220 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Returning 404 to user: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:15.826220 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d194a62f-972b-456c-a3cc-121143cdc752 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 404 len: 111 microversion: 2.1 time: 0.032474 May 27 03:28:15.827571 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 341/709] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:15 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:28:15.833087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8a89522b-b118-4381-b9b5-dddb1c92ccdc tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '.version_select at 0x7f5e7401d9d0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:15.858059 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8a89522b-b118-4381-b9b5-dddb1c92ccdc tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-471684052" status: 202 len: 0 microversion: 2.1 time: 0.029375 May 27 03:28:15.858844 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 369/710] 10.222.0.50 () {58 vars in 1217 bytes} [Fri May 27 03:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-471684052 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:28:16.491922 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-5505926e-5961-4895-b12e-b080c7c756e1 req-9ac92863-2c92-431d-b8be-cd080d4915f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d25eaff-39bb-4434-848b-7b2dcc68d1e9", "tag": "7548807f-da0a-4e25-9317-457dbf196bc6"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:16.505890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5505926e-5961-4895-b12e-b080c7c756e1 req-9ac92863-2c92-431d-b8be-cd080d4915f9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.506389 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5505926e-5961-4895-b12e-b080c7c756e1 req-9ac92863-2c92-431d-b8be-cd080d4915f9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.520876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-5505926e-5961-4895-b12e-b080c7c756e1 req-9ac92863-2c92-431d-b8be-cd080d4915f9 service nova] Creating event network-changed:7548807f-da0a-4e25-9317-457dbf196bc6 for instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 on hv-cinder-82880 May 27 03:28:16.527313 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-5505926e-5961-4895-b12e-b080c7c756e1 req-9ac92863-2c92-431d-b8be-cd080d4915f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041466 May 27 03:28:16.528294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 342/711] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:16.586949 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f3d188c8-ccb1-4b15-8b37-3e4650e78c8e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'create', calling method: .version_select at 0x7f5e6f74cc10>, body: {"keypair": {"name": "tempest-keypair-31173070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOyU1gr4QucsyPooH0227hd95VnDHYNQ20+Oo89zTyGEPCZnvF6TO7aK5Gavwl+SZ+JPPllDqlUR/aGYp2zWKgCN7H70GxVqOw+sYIShUWmOa1bximZWiXGC70Wxz8r/Q=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:16.613299 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-f3d188c8-ccb1-4b15-8b37-3e4650e78c8e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for project 9351d2e0e0e14585820951a9398b35f4. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:16.618914 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-f3d188c8-ccb1-4b15-8b37-3e4650e78c8e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for user 19457c759f0b4f5cbc530364af1f47d7 and project 9351d2e0e0e14585820951a9398b35f4. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:16.650286 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f3d188c8-ccb1-4b15-8b37-3e4650e78c8e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.068658 May 27 03:28:16.657895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 370/712] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:28:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:16.675066 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:16.676053 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:16.691864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.692323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:16.693430 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:16.693875 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:17.123480 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:17.135269 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:17.137580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:17.139857 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7dfbf574-1a46-4cee-8f97-1a2dc37972e2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.469727 May 27 03:28:17.141052 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 343/713] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:16 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:18.159511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:18.160119 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:18.166344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:18.166879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:18.167555 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:18.167987 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:18.205421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:18.221673 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2022592334", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc2d2605-cf0b-41cc-a4d1-c3c28ec94860"}], "security_groups": [{"name": "tempest-securitygroup--398819999"}], "key_name": "tempest-keypair-31173070", "user_data": "}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:18.309141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:18.318084 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:18.319627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:18.320741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4ef71e6e-eb2d-489a-96e7-eb8683f9d997 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.166332 May 27 03:28:18.321357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 371/714] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:18 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:18.334735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] validate_networks() for [('cc2d2605-cf0b-41cc-a4d1-c3c28ec94860', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:28:18.372300 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:18.548723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-df85017b-0c83-49b3-937e-6cf950a42c7a req-2d41a610-14f7-4d76-ab29-712e57f2ab37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa1b29c-4aa9-4ece-a9ee-fd84d519970f", "tag": "5e76e5be-43aa-4f7f-9313-3304d2fd1b0d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:18.557131 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-df85017b-0c83-49b3-937e-6cf950a42c7a req-2d41a610-14f7-4d76-ab29-712e57f2ab37 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:18.557589 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-df85017b-0c83-49b3-937e-6cf950a42c7a req-2d41a610-14f7-4d76-ab29-712e57f2ab37 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:18.569158 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-df85017b-0c83-49b3-937e-6cf950a42c7a req-2d41a610-14f7-4d76-ab29-712e57f2ab37 service nova] Creating event network-changed:5e76e5be-43aa-4f7f-9313-3304d2fd1b0d for instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f on hv-cinder-82880 May 27 03:28:18.574456 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-df85017b-0c83-49b3-937e-6cf950a42c7a req-2d41a610-14f7-4d76-ab29-712e57f2ab37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029687 May 27 03:28:18.575120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 372/715] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:19.003201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:28:19.003729 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:28:19.004282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:28:19.004816 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:28:19.005326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:28:19.017776 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:19.018226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:19.019015 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:19.019443 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:19.035990 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for project 9351d2e0e0e14585820951a9398b35f4. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:19.040077 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Getting quotas for user 19457c759f0b4f5cbc530364af1f47d7 and project 9351d2e0e0e14585820951a9398b35f4. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:19.051992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:28:19.054169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:28:19.105695 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-28cfe08b-7032-43b9-b331-4bf67feedb7b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.888115 May 27 03:28:19.106408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 344/716] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:28:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:28:19.117824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7c949420-2ce3-46ae-9bc7-39a37e59496f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:19.118683 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7c949420-2ce3-46ae-9bc7-39a37e59496f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:19.120747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:19.189234 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7c949420-2ce3-46ae-9bc7-39a37e59496f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.199222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7c949420-2ce3-46ae-9bc7-39a37e59496f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1236 microversion: 2.1 time: 0.085811 May 27 03:28:19.200269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 373/717] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:19 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1236 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:19.341239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:19.342156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:19.352254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:19.353104 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:19.353868 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:19.354363 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:19.506777 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.515833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.517632 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:19.518781 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b47bb70b-cb47-4828-893b-585eae926865 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.182317 May 27 03:28:19.519326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 345/718] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:19 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:20.217166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:20.217783 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:20.225440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.225891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.226659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.227104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.291528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.300038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cfe347e5-07f8-4add-9662-3f730c3b3245 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1288 microversion: 2.1 time: 0.086763 May 27 03:28:20.300497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 374/719] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:20 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:20.541477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:20.541477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:20.546725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.547289 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.548312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:20.548845 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:20.764465 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.774166 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.775666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:20.776768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6abd18e9-43a1-4ebd-8688-8cab9c201c48 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.242710 May 27 03:28:20.777367 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 346/720] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:20 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:21.317194 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:21.318384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:21.325270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.326063 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.327058 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.327692 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.473957 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:21.481943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bba43954-614d-4972-a8dc-227719d84f0d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.168614 May 27 03:28:21.482627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 375/721] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:21 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:21.796033 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:21.801809 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:21.810529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.810964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:21.811719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:21.811921 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.812916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.816666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.822999 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.823457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.824244 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:21.824683 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:21.871711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:28:22.021892 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5b542576-93a1-4821-a47e-917f89f4a256 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "DELETE /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 204 len: 0 microversion: 2.1 time: 0.214249 May 27 03:28:22.025744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 376/722] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:28:21 2022] DELETE /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:28:22.031922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:22.032626 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:22.039046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:22.039696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:22.040643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:22.041395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:22.293406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:22.309013 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-65658643-8d65-4279-a808-16e305c6c667 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1576 microversion: 2.1 time: 0.281466 May 27 03:28:22.309654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 377/723] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:22 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:22.377959 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:22.387026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:22.388533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:22.389685 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0e1aa14e-047e-4a16-a9cd-c9523ade32b7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.597664 May 27 03:28:22.390228 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 347/724] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:21 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:22.448604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-f9300cc4-7a6d-4f7f-aafc-19d8b4eecbf8 req-098d7c44-3633-4c9a-af5c-d41fd1dd0829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a630735e-10a7-46fd-912c-a1792d18fd15", "tag": "d6a48426-132d-46f7-b088-8df0294adfe1"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:22.461278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-f9300cc4-7a6d-4f7f-aafc-19d8b4eecbf8 req-098d7c44-3633-4c9a-af5c-d41fd1dd0829 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:22.461956 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-f9300cc4-7a6d-4f7f-aafc-19d8b4eecbf8 req-098d7c44-3633-4c9a-af5c-d41fd1dd0829 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:22.473820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-f9300cc4-7a6d-4f7f-aafc-19d8b4eecbf8 req-098d7c44-3633-4c9a-af5c-d41fd1dd0829 service nova] Creating event network-changed:d6a48426-132d-46f7-b088-8df0294adfe1 for instance a630735e-10a7-46fd-912c-a1792d18fd15 on hv-cinder-82880 May 27 03:28:22.478520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-f9300cc4-7a6d-4f7f-aafc-19d8b4eecbf8 req-098d7c44-3633-4c9a-af5c-d41fd1dd0829 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 May 27 03:28:22.479129 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 378/725] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:22.499985 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:22.501343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:22.508423 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:22.510183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:22.511199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:22.511791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:22.653022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:22.662708 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-506afbab-bc6f-4cfe-9321-901cb761e765 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.167485 May 27 03:28:22.663365 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 348/726] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:22 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:23.330252 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:23.331097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:23.338367 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:23.338903 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.339748 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:23.340254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.374923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-60cd095a-50e9-44d3-b618-be8a06fcc9de req-43da1087-d40e-4568-a896-3603fa77be51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1b29c-4aa9-4ece-a9ee-fd84d519970f", "name": "network-vif-plugged", "status": "completed", "tag": "5e76e5be-43aa-4f7f-9313-3304d2fd1b0d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:23.399615 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-60cd095a-50e9-44d3-b618-be8a06fcc9de req-43da1087-d40e-4568-a896-3603fa77be51 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:23.400432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-60cd095a-50e9-44d3-b618-be8a06fcc9de req-43da1087-d40e-4568-a896-3603fa77be51 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.414951 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-60cd095a-50e9-44d3-b618-be8a06fcc9de req-43da1087-d40e-4568-a896-3603fa77be51 service nova] Creating event network-vif-plugged:5e76e5be-43aa-4f7f-9313-3304d2fd1b0d for instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f on hv-cinder-82880 May 27 03:28:23.422179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-60cd095a-50e9-44d3-b618-be8a06fcc9de req-43da1087-d40e-4568-a896-3603fa77be51 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058710 May 27 03:28:23.423795 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 349/727] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:23.430592 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:23.431743 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:23.438699 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:23.439242 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.440196 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:23.440818 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.510166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:23.519005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-94d7646f-8055-4cb5-9158-3f9d9f44941a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1576 microversion: 2.1 time: 0.193587 May 27 03:28:23.519747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 379/728] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:23 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:23.641735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:23.650262 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:23.651802 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:23.652888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5c0ed7ce-9798-469c-8e4e-836213b41b6b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.227182 May 27 03:28:23.653522 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 350/729] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:23 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:23.680263 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:23.681128 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:23.687538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:23.688194 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.689166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:23.689668 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:23.838795 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:23.848340 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4cba772c-1c4b-448d-aae4-a09b0d9a17c9 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.172267 May 27 03:28:23.849070 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 380/730] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:23 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:24.537515 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:24.538117 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:24.548738 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.549467 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.551622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.553387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.673101 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:24.674433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:24.687281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.688530 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.689820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.690453 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.858826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:24.875614 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4c25ab69-c48c-47ce-90b2-efd6521bc969 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1576 microversion: 2.1 time: 0.343096 May 27 03:28:24.877480 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 351/731] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:24 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1576 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:24.893860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:24.894969 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:24.902510 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:24.904900 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.907407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.909008 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:24.909681 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:24.915505 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:24.934701 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:24.937431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:24.941992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-22de3129-e509-4f8b-b159-c88624faad7f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1405 microversion: 2.20 time: 0.271796 May 27 03:28:24.952690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 381/732] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:24 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:25.302915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:25.312556 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e5bdee9a-c1f3-414f-82ac-061047d45918 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.423283 May 27 03:28:25.322679 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 352/733] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:24 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:25.623988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-2bad77fb-baaa-407c-89c7-d2ed2f218758 req-5ee46aa0-6d01-440a-b041-caca2359247b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f03d50-8598-4db5-b3fd-ee77a878c5e4", "name": "network-vif-deleted", "tag": "af8e6fc6-1227-49b2-a57c-d9ab051c9fe9"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:25.641364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2bad77fb-baaa-407c-89c7-d2ed2f218758 req-5ee46aa0-6d01-440a-b041-caca2359247b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.642549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2bad77fb-baaa-407c-89c7-d2ed2f218758 req-5ee46aa0-6d01-440a-b041-caca2359247b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.654632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-2bad77fb-baaa-407c-89c7-d2ed2f218758 req-5ee46aa0-6d01-440a-b041-caca2359247b service nova] Creating event network-vif-deleted:af8e6fc6-1227-49b2-a57c-d9ab051c9fe9 for instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 on hv-cinder-82880 May 27 03:28:25.663050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-2bad77fb-baaa-407c-89c7-d2ed2f218758 req-5ee46aa0-6d01-440a-b041-caca2359247b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042604 May 27 03:28:25.664019 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 382/734] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:28:25.895079 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:25.895700 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:25.905884 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.906342 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.907573 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.908184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.967363 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:25.969220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:25.979405 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.980265 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:25.981426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:25.982052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:26.022295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.035336 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-07c3bacc-2df8-4cb8-882e-dcb7318cb163 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1508 microversion: 2.1 time: 0.144705 May 27 03:28:26.042903 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 353/735] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:25 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:26.152434 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.161257 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.164080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.166261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9ac3e569-f595-4205-9292-0801c6e35bce tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1596 microversion: 2.20 time: 0.208888 May 27 03:28:26.167372 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 383/736] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:28:25 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1596 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:28:26.184763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-010f36fa-0c79-48b4-a289-357b68bcebf2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:26.185424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-010f36fa-0c79-48b4-a289-357b68bcebf2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:26.192796 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010f36fa-0c79-48b4-a289-357b68bcebf2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:26.193492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010f36fa-0c79-48b4-a289-357b68bcebf2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:26.194481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010f36fa-0c79-48b4-a289-357b68bcebf2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:26.195151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010f36fa-0c79-48b4-a289-357b68bcebf2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:26.331781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:26.332536 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:26.347174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:26.347635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:26.348431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:26.348871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:26.360771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-010f36fa-0c79-48b4-a289-357b68bcebf2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.179387 May 27 03:28:26.361408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 354/737] 10.222.0.50 () {60 vars in 1315 bytes} [Fri May 27 03:28:26 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:28:26.830449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:26.883661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9541e1b3-75c8-4def-81ef-093a486c6d0e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.555746 May 27 03:28:26.885998 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 384/738] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:26 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:27.054119 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:27.054820 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:27.068661 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.069154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.069947 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.070386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.125796 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.126406 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.127323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lazy-loading 'fault' on Instance uuid 31f03d50-8598-4db5-b3fd-ee77a878c5e4 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:27.180625 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:27.189416 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-37301ead-77ed-4d6e-b740-8da7cbc19ff4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 200 len: 1228 microversion: 2.1 time: 0.139600 May 27 03:28:27.190039 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 355/739] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:27 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 1228 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:27.902649 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:27.903869 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:27.911490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.912161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:27.913129 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:27.913714 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.129974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-33f17b3c-169c-47e4-a4ca-c997fe354a3d req-16dcabf5-7837-4705-b7fe-e9cacd9e181a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa1b29c-4aa9-4ece-a9ee-fd84d519970f", "tag": "5e76e5be-43aa-4f7f-9313-3304d2fd1b0d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:28.159578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-33f17b3c-169c-47e4-a4ca-c997fe354a3d req-16dcabf5-7837-4705-b7fe-e9cacd9e181a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:28.160134 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-33f17b3c-169c-47e4-a4ca-c997fe354a3d req-16dcabf5-7837-4705-b7fe-e9cacd9e181a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.176072 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-33f17b3c-169c-47e4-a4ca-c997fe354a3d req-16dcabf5-7837-4705-b7fe-e9cacd9e181a service nova] Creating event network-changed:5e76e5be-43aa-4f7f-9313-3304d2fd1b0d for instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f on hv-cinder-82880 May 27 03:28:28.183472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-33f17b3c-169c-47e4-a4ca-c997fe354a3d req-16dcabf5-7837-4705-b7fe-e9cacd9e181a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064955 May 27 03:28:28.185542 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 356/740] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:28:28.196360 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:28.210391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:28.212430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e003b6cc-2aab-47ba-8b8d-f2378e8504cf tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.313522 May 27 03:28:28.219284 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:28.223955 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 385/741] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:27 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:28.232908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:28.234606 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.236221 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:28.236943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:28.255717 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] HTTP exception thrown: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Request method failure captured: May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 HTTP/1.1 May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikERaV10kgaA5xz2Gpv0AIVykracYjCaosXJElTjQaqAaPXyBgmBobK7AyyTHGE64WsqMLFsQ-EHbPAfSDffhNS3e2_dHu1YtNIL-Ze8SvcSdPRazTshnWUsTYrfio3MYqOj-KfOl2fMzcCH4p61RLgXujbQ9uJAbVz08jgpEyedVSw0 May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: d5bef1b49d424299864523887eb72b3c May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:28:28.258752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5bef1b49d424299864523887eb72b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestVolumeBootPattern-1900631948 May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: d5bef1b49d424299864523887eb72b3c May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-TestVolumeBootPattern-1900631948-project May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 01be6ea7136e45aead352146193f05ed May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestVolumeBootPattern-1900631948-project May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:28:28.260905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '31f03d50-8598-4db5-b3fd-ee77a878c5e4'} May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:28.261727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:28:28.263029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:28:28.264052 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Returning 404 to user: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:28.264052 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-77ce1b92-6420-4180-afed-b4e20de0cfe8 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 404 len: 111 microversion: 2.1 time: 0.058123 May 27 03:28:28.270213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 357/742] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:28 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:28:28.445643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-801572698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-940256736", "security_groups": [{"name": "tempest-secgroup-smoke-1104536221"}], "block_device_mapping_v2": [{"uuid": "d87d0a9c-3296-4457-ac47-9a6c1f204a60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79e2e930-0200-4ceb-a2bb-a93bbb04e0f6"}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:29.023781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] validate_networks() for [('79e2e930-0200-4ceb-a2bb-a93bbb04e0f6', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:28:29.199590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=12 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:29.229692 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:29.230910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:29.233309 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:29.234173 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:29.245245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.246933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.247932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.248633 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.743435 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:29.751705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-45666cc4-5002-41cc-9e57-cbd478339495 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.525768 May 27 03:28:29.752415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 358/743] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:29 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:29.846969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:28:29.848515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:28:29.849242 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:28:29.849793 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:28:29.850440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:28:29.867648 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.868106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.869300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:29.869741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:29.890521 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for project d5bef1b49d424299864523887eb72b3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:29.895089 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for user 01be6ea7136e45aead352146193f05ed and project d5bef1b49d424299864523887eb72b3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:29.957982 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:28:29.960066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d87d0a9c-3296-4457-ac47-9a6c1f204a60',volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:28:30.144049 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1e110227-8ec4-472a-a7b6-5e6989b9dfc1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.702595 May 27 03:28:30.146000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 386/744] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:28:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:28:30.156366 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e3d2b636-3bc1-4651-bc28-061702e0bfbc tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:30.157464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e3d2b636-3bc1-4651-bc28-061702e0bfbc tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:30.241869 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e3d2b636-3bc1-4651-bc28-061702e0bfbc tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:30.253425 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e3d2b636-3bc1-4651-bc28-061702e0bfbc tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1093 microversion: 2.1 time: 0.100302 May 27 03:28:30.254030 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 359/745] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:30 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1093 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:30.769437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:30.770120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:30.778737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:30.779191 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:30.779964 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:30.785848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:30.789270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:30.987716 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:30.996930 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7cb08a1e-47ea-4eb3-a6a1-ee75f8a533f2 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.231758 May 27 03:28:30.997747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 387/746] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:30 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:31.271639 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:31.272835 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:31.287561 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:31.292363 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:31.293516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:31.293950 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:31.416012 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:31.426132 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-35665be9-7265-4c29-9ce4-2ffaf0a989df tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1191 microversion: 2.1 time: 0.158452 May 27 03:28:31.427338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 360/747] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:31 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1191 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:32.015285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:32.016988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:32.029889 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.030716 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.035113 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.036518 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.386403 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:32.403414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-de8958b2-d847-45d7-b284-d95a7915ed98 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.389974 May 27 03:28:32.406270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 388/748] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:32 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:32.446983 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:32.448578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:32.475807 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.476888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.479709 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:32.481304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:32.565555 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:33.045299 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:33.068895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-161ff7a5-0c30-4ccc-bccd-4bb701714344 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1277 microversion: 2.1 time: 0.627959 May 27 03:28:33.072487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 361/749] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:32 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1277 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:33.423654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:33.424289 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:33.432533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:33.439080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:33.440185 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:33.441489 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:33.896366 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:33.925788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8d1b8e50-ee75-47fc-b956-98eae23b25ae tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.506422 May 27 03:28:33.926938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 389/750] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:33 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:34.021664 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-08e07154-6b47-42ef-87a0-15bec76cac1f req-8c3b955f-17de-4cd2-8203-809039a63c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a630735e-10a7-46fd-912c-a1792d18fd15", "name": "network-vif-plugged", "status": "completed", "tag": "d6a48426-132d-46f7-b088-8df0294adfe1"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:34.049546 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-08e07154-6b47-42ef-87a0-15bec76cac1f req-8c3b955f-17de-4cd2-8203-809039a63c47 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.050034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-08e07154-6b47-42ef-87a0-15bec76cac1f req-8c3b955f-17de-4cd2-8203-809039a63c47 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:34.086648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-08e07154-6b47-42ef-87a0-15bec76cac1f req-8c3b955f-17de-4cd2-8203-809039a63c47 service nova] Creating event network-vif-plugged:d6a48426-132d-46f7-b088-8df0294adfe1 for instance a630735e-10a7-46fd-912c-a1792d18fd15 on hv-cinder-82880 May 27 03:28:34.095586 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-08e07154-6b47-42ef-87a0-15bec76cac1f req-8c3b955f-17de-4cd2-8203-809039a63c47 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083668 May 27 03:28:34.095796 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:34.099750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:34.100430 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 362/751] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:34.124296 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.124791 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:34.126122 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.126333 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:34.408128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-a0a401ab-708b-4aa2-ab7b-8c9cc50c6118 req-204067db-88be-47db-b857-c581e2920145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbdd423-cd44-475e-abb9-2c765b71b978", "tag": "500f9575-c4a4-47bd-be17-a054e686429b"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:34.424711 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a0a401ab-708b-4aa2-ab7b-8c9cc50c6118 req-204067db-88be-47db-b857-c581e2920145 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.428833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a0a401ab-708b-4aa2-ab7b-8c9cc50c6118 req-204067db-88be-47db-b857-c581e2920145 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:34.478449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-a0a401ab-708b-4aa2-ab7b-8c9cc50c6118 req-204067db-88be-47db-b857-c581e2920145 service nova] Creating event network-changed:500f9575-c4a4-47bd-be17-a054e686429b for instance 5bbdd423-cd44-475e-abb9-2c765b71b978 on hv-cinder-82880 May 27 03:28:34.488938 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-a0a401ab-708b-4aa2-ab7b-8c9cc50c6118 req-204067db-88be-47db-b857-c581e2920145 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094825 May 27 03:28:34.489748 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 363/752] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:28:34.949390 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:34.950268 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:34.965351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:34.981987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.982986 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:34.983962 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-589a39af-b56a-4768-bd87-0f9a5585683b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.898354 May 27 03:28:34.986274 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 390/753] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:34 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:34.987681 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:34.988402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:35.239029 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:35.247141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9351401c-e8e0-4a54-8c45-9cff3dbc5a38 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.306888 May 27 03:28:35.248053 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 364/754] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:34 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:35.767010 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:35.768008 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:35.774932 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:35.775469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:35.776345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:35.776862 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:35.906133 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'services' on Instance uuid b967195a-9c2e-4f9f-9a09-65a4101b07c8 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:35.993430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d8e35e0b-3ab3-4928-9be0-835986ebe085 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments/5881c651-96ab-4b4a-aeca-ee789e8a7e38" status: 202 len: 0 microversion: 2.1 time: 0.230750 May 27 03:28:35.994136 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 391/755] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:28:35 2022] DELETE /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments/5881c651-96ab-4b4a-aeca-ee789e8a7e38 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:28:36.004803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1a6f1c41-18a0-4282-bef8-343fb39ac28e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:36.005914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1a6f1c41-18a0-4282-bef8-343fb39ac28e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:36.015770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c41-18a0-4282-bef8-343fb39ac28e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.020470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:36.021199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c41-18a0-4282-bef8-343fb39ac28e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.022321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c41-18a0-4282-bef8-343fb39ac28e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.023043 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c41-18a0-4282-bef8-343fb39ac28e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.027115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:36.036388 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.038019 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.039010 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.039601 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.073404 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1a6f1c41-18a0-4282-bef8-343fb39ac28e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074495 May 27 03:28:36.078994 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 365/756] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:28:35 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:28:36.274631 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:36.277401 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:36.284663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.285392 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.286554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:36.287146 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:36.422443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:36.433495 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2b8f71eb-099a-455f-a8c0-8347c733343d tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.422231 May 27 03:28:36.434428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 392/757] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:36 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:36.469542 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:36.476992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-157deafb-a354-4529-ad33-011a7cc77b91 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1361 microversion: 2.1 time: 0.215877 May 27 03:28:36.477503 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 366/758] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:36 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:37.086618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-510f3c6e-36ee-4dc8-912d-082b1421a008 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:37.088457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-510f3c6e-36ee-4dc8-912d-082b1421a008 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:37.096167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-510f3c6e-36ee-4dc8-912d-082b1421a008 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.096926 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-510f3c6e-36ee-4dc8-912d-082b1421a008 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.097936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-510f3c6e-36ee-4dc8-912d-082b1421a008 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.098839 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-510f3c6e-36ee-4dc8-912d-082b1421a008 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.136050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-510f3c6e-36ee-4dc8-912d-082b1421a008 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054835 May 27 03:28:37.136851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 393/759] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:28:37 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:37.452889 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:37.453665 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:37.463859 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.464304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.465115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.465549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.753146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:37.753858 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:37.765023 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.765481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.766333 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:37.766820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:37.823732 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:37.834094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5fbefa12-6217-4767-a328-75f48d3c4818 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.386597 May 27 03:28:37.837007 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 367/760] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:37 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:37.961408 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:37.973202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-61db7e9b-af30-4917-904c-7994152bbd7f tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1546 microversion: 2.1 time: 0.483369 May 27 03:28:37.974400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 394/761] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:37 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1546 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:37.998900 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-efb395c6-27ab-4fca-893e-a9fe07e56582 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:37.999280 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-efb395c6-27ab-4fca-893e-a9fe07e56582 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:38.007954 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-efb395c6-27ab-4fca-893e-a9fe07e56582 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.008649 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-efb395c6-27ab-4fca-893e-a9fe07e56582 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.010569 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-efb395c6-27ab-4fca-893e-a9fe07e56582 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.011492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-efb395c6-27ab-4fca-893e-a9fe07e56582 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.151514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-efb395c6-27ab-4fca-893e-a9fe07e56582 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164345 May 27 03:28:38.152463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-99d93a54-bfe8-4da3-81f6-cb298d3bd499 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:38.159519 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 368/762] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:28:37 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:38.161534 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-99d93a54-bfe8-4da3-81f6-cb298d3bd499 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:38.169025 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99d93a54-bfe8-4da3-81f6-cb298d3bd499 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.169753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99d93a54-bfe8-4da3-81f6-cb298d3bd499 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.171232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99d93a54-bfe8-4da3-81f6-cb298d3bd499 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.171902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99d93a54-bfe8-4da3-81f6-cb298d3bd499 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.278824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-99d93a54-bfe8-4da3-81f6-cb298d3bd499 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130182 May 27 03:28:38.283898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 395/763] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:28:38 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:28:38.378021 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:38.379402 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:38.386648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.387318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.388259 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.388867 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.426160 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:28:38.628855 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c8c64d9d-6724-4c1e-9671-3c4df99f9025 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 204 len: 0 microversion: 2.1 time: 0.255610 May 27 03:28:38.629880 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 369/764] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:28:38 2022] DELETE /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:28:38.638355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:38.638967 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:38.647645 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.648098 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.648880 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.649353 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.851330 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:38.852116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:38.868695 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.869282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.870296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:38.871062 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:38.983732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:38.997196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1c72183a-1076-4b19-ad1e-1779402c2fd8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1689 microversion: 2.1 time: 0.363147 May 27 03:28:39.000644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 396/765] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:38 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1689 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:39.168637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:39.178689 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d51d92c4-7323-4928-bec9-eaaf5881a000 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.331536 May 27 03:28:39.179267 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 370/766] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:38 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:39.591795 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-9c25bf4c-0827-4288-9939-e42d1af233c7 req-2b523f3c-8367-44ec-a844-55e505b402bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a630735e-10a7-46fd-912c-a1792d18fd15", "tag": "d6a48426-132d-46f7-b088-8df0294adfe1"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:39.606702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-9c25bf4c-0827-4288-9939-e42d1af233c7 req-2b523f3c-8367-44ec-a844-55e505b402bb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:39.607505 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-9c25bf4c-0827-4288-9939-e42d1af233c7 req-2b523f3c-8367-44ec-a844-55e505b402bb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:39.807983 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-9c25bf4c-0827-4288-9939-e42d1af233c7 req-2b523f3c-8367-44ec-a844-55e505b402bb service nova] Creating event network-changed:d6a48426-132d-46f7-b088-8df0294adfe1 for instance a630735e-10a7-46fd-912c-a1792d18fd15 on hv-cinder-82880 May 27 03:28:39.813858 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-9c25bf4c-0827-4288-9939-e42d1af233c7 req-2b523f3c-8367-44ec-a844-55e505b402bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225771 May 27 03:28:39.815107 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 397/767] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:40.017893 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:40.019407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:40.029223 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:40.029920 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:40.030691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:40.031428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:40.197857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:40.198973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:40.215157 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:40.215594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:40.217114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:40.219898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:40.220603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:40.221573 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:40.222100 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:40.224216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-01ec7e51-79c1-4936-a04e-2c9d38ace01f tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1689 microversion: 2.1 time: 0.210865 May 27 03:28:40.238011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 371/768] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:40 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:40.475549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:40.484070 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1fa78b55-c97a-4321-b00b-a2e5a29a3d5f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.291984 May 27 03:28:40.485658 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 398/769] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:40 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:41.251788 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:41.257180 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:41.257913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:41.264923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:41.265420 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:41.266381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:41.267712 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:41.454384 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:41.462612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b488d88c-404c-4b7d-ae0b-46cd2ba237be tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1689 microversion: 2.1 time: 0.211539 May 27 03:28:41.465800 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 372/770] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:41 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:41.501853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:41.502462 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:41.511908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:41.512143 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:41.512931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:41.513475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:41.668597 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:41.677717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c0874194-a59d-4b10-88e5-76d4e9c2c949 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.179671 May 27 03:28:41.678475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 399/771] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:41 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:42.479842 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:42.480444 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:42.490189 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:42.490902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:42.491829 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:42.492449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:42.695367 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:42.696770 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:42.707737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:42.708787 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:42.710970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:42.712542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:42.734477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:42.745843 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4b06c33d-0a27-4129-aa78-a7faa0f23df8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1689 microversion: 2.1 time: 0.269930 May 27 03:28:42.748942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 373/772] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:42 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1689 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:42.896202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:42.904430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-563e34a6-6872-4693-a132-fc56df7f3124 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.212913 May 27 03:28:42.907235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 400/773] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:42 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:43.767173 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:43.767903 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:43.784887 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:43.785445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:43.786346 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:43.786873 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:43.921538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:43.922823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:43.932001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:43.932455 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:43.933278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:43.933718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:44.017380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:44.038291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0530246c-78c8-4e16-a8e1-7728d2bbb015 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1689 microversion: 2.1 time: 0.277818 May 27 03:28:44.038806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 374/774] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:43 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:44.473483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:44.483614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-102b8e80-56e1-4fea-a5f0-217d2d24affe tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.565332 May 27 03:28:44.483614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 401/775] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:43 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:45.055782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:45.056478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:45.072700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:45.073194 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:45.073962 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:45.086846 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:45.146395 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-e5fa7d1f-dd23-4463-a79e-8823cd9a4580 req-58f5af89-e92b-4f8c-9bab-8799f1b2a03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b967195a-9c2e-4f9f-9a09-65a4101b07c8", "name": "network-vif-deleted", "tag": "00901745-e24d-4624-8550-b70ca512f20a"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:45.160198 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e5fa7d1f-dd23-4463-a79e-8823cd9a4580 req-58f5af89-e92b-4f8c-9bab-8799f1b2a03e service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:45.161110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e5fa7d1f-dd23-4463-a79e-8823cd9a4580 req-58f5af89-e92b-4f8c-9bab-8799f1b2a03e service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:45.179326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-e5fa7d1f-dd23-4463-a79e-8823cd9a4580 req-58f5af89-e92b-4f8c-9bab-8799f1b2a03e service nova] Creating event network-vif-deleted:00901745-e24d-4624-8550-b70ca512f20a for instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 on hv-cinder-82880 May 27 03:28:45.185512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-e5fa7d1f-dd23-4463-a79e-8823cd9a4580 req-58f5af89-e92b-4f8c-9bab-8799f1b2a03e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160977 May 27 03:28:45.187265 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 375/776] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:45.233918 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:45.248290 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ac7e37a1-5f5e-496d-8526-68a71b33ee17 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 200 len: 1330 microversion: 2.1 time: 0.196362 May 27 03:28:45.248889 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 402/777] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:45 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 1330 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:45.500691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:45.501414 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:45.514775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:45.515257 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:45.516034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:45.516726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:45.781853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:45.793399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-13d53897-cec9-46dd-bb71-e917a6f5e217 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.297101 May 27 03:28:45.794540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 376/778] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:45 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:46.271051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:46.271795 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: b967195a-9c2e-4f9f-9a09-65a4101b07c8] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:46.281127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:46.282048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:46.283085 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:46.283721 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:46.298251 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] HTTP exception thrown: Instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 could not be found. May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Request method failure captured: May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 HTTP/1.1 May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQvkgP6dheA1HISWpdWxeiMUoVKTOpvwrpfLG-ikSRwPw6Oq6pJowRRCtPYOjlAZkPx6l1XfuLMN1XJmMcVOfiQL4cYiJx5ijWcOp_OLv9lVLF8Xf_ooNsu_C-fVamGPpIZtMPA-zLDtioWYSFm6PMhCcJi0NjCRk6CyajVkFIWqV0 May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:28:46.300513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 468a46d55bd342739b9cd78bcd3a77fc May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 could not be found. May 27 03:28:46.301867 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'b967195a-9c2e-4f9f-9a09-65a4101b07c8'} May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 could not be found. May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:28:46.302603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 could not be found. May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 could not be found. May 27 03:28:46.303803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:28:46.306294 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Returning 404 to user: Instance b967195a-9c2e-4f9f-9a09-65a4101b07c8 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:28:46.307744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fd9001e4-bee1-438f-9a7f-f4dfb8963d8e tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8" status: 404 len: 111 microversion: 2.1 time: 0.040082 May 27 03:28:46.311417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 403/779] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:46 2022] GET /compute/v2.1/servers/b967195a-9c2e-4f9f-9a09-65a4101b07c8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:28:46.317182 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7bb45f5a-b7c6-431c-ac6d-3a6e9802b315 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '.version_select at 0x7f5e6f74aa60>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:46.339598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7bb45f5a-b7c6-431c-ac6d-3a6e9802b315 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984984206" status: 202 len: 0 microversion: 2.1 time: 0.026805 May 27 03:28:46.344780 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 377/780] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 03:28:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984984206 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:28:46.811607 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:46.812660 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:46.827059 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:46.827835 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:46.831173 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:46.831891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:46.860988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:47.034279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:47.059895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cc195702-d067-4284-abb9-2b1e48139b80 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.252022 May 27 03:28:47.061188 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 404/781] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:46 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:47.499827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-2151202c-7bc9-4ac8-b6d8-f804a9707dc7 req-b2d50551-f0df-484f-b486-8e9b75241594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbdd423-cd44-475e-abb9-2c765b71b978", "name": "network-vif-plugged", "status": "completed", "tag": "500f9575-c4a4-47bd-be17-a054e686429b"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:47.521622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2151202c-7bc9-4ac8-b6d8-f804a9707dc7 req-b2d50551-f0df-484f-b486-8e9b75241594 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:47.522208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2151202c-7bc9-4ac8-b6d8-f804a9707dc7 req-b2d50551-f0df-484f-b486-8e9b75241594 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:47.536287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-2151202c-7bc9-4ac8-b6d8-f804a9707dc7 req-b2d50551-f0df-484f-b486-8e9b75241594 service nova] Creating event network-vif-plugged:500f9575-c4a4-47bd-be17-a054e686429b for instance 5bbdd423-cd44-475e-abb9-2c765b71b978 on hv-cinder-82880 May 27 03:28:47.543255 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-2151202c-7bc9-4ac8-b6d8-f804a9707dc7 req-b2d50551-f0df-484f-b486-8e9b75241594 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047775 May 27 03:28:47.544453 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 378/782] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:48.078811 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:48.079369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:48.087310 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:48.087763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:48.088546 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:48.089014 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:48.236066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:48.243855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-19bb089e-5a70-49aa-8fb4-c4c56145f66a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.170703 May 27 03:28:48.244427 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 405/783] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:48 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:48.314240 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e378991-6bfd-4b7e-a86f-8121d47b71fa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Action: 'create', calling method: .version_select at 0x7f5e74082310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-977980413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRMkipXMJIPdq0sqAwNxpMb4O2sL+FHagbgTUx001vQbwB9bI0/t6VQHzFksW2yId91i4BSsR7Fy7sXSU9Mgd7G6BiykbewWGAsrSZFbotobZbijIUhbW8tB+NConEIxA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:48.329033 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9e378991-6bfd-4b7e-a86f-8121d47b71fa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Getting quotas for project f03723b938b845309929162c81adfe51. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:48.333035 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9e378991-6bfd-4b7e-a86f-8121d47b71fa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Getting quotas for user e38e8354a69642fba0c0949fe5f5dab3 and project f03723b938b845309929162c81adfe51. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:48.359882 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e378991-6bfd-4b7e-a86f-8121d47b71fa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049969 May 27 03:28:48.360515 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 379/784] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:28:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:48.427168 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1049679166", "imageRef": "70ab545b-ebcf-42b8-b5d6-e6b72da92889", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-977980413", "networks": [{"uuid": "25414d0e-39e2-4b3e-a787-1a7de54b6d2c"}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:48.476718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] validate_networks() for [('25414d0e-39e2-4b3e-a787-1a7de54b6d2c', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:28:48.953161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:28:48.953638 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:28:48.954106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:28:48.954539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:28:48.954943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:28:48.966382 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:48.966846 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:48.967629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:48.968091 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:48.985219 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Getting quotas for project f03723b938b845309929162c81adfe51. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:28:48.989378 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Getting quotas for user e38e8354a69642fba0c0949fe5f5dab3 and project f03723b938b845309929162c81adfe51. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:28:48.990765 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:49.004470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:28:49.006856 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70ab545b-ebcf-42b8-b5d6-e6b72da92889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:28:49.057490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a779739e-e4e9-482d-8525-8137cf9385aa tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634147 May 27 03:28:49.058144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 406/785] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:28:49.068902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b06c2fcd-6527-4e3a-a2d5-2ac2277fed63 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:49.070098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b06c2fcd-6527-4e3a-a2d5-2ac2277fed63 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:49.127135 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b06c2fcd-6527-4e3a-a2d5-2ac2277fed63 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:49.135550 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b06c2fcd-6527-4e3a-a2d5-2ac2277fed63 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1258 microversion: 2.1 time: 0.071203 May 27 03:28:49.136250 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 380/786] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:49 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:49.261891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:49.262531 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:49.269847 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.270547 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.271315 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.271765 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.428984 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:49.437351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ba259722-1631-4542-9676-c1bff9d85211 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1265 microversion: 2.1 time: 0.179970 May 27 03:28:49.438599 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 407/787] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:49 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:49.480751 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:49.481284 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:49.487795 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.488230 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.488984 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.489433 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.514862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:28:49.545670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:49.599051 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-82e2ac7d-fbdb-4196-abf1-4f901301a2fa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "DELETE /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 204 len: 0 microversion: 2.1 time: 0.121946 May 27 03:28:49.599628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 381/788] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:28:49 2022] DELETE /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:28:49.607781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:49.608396 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:49.614853 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.615299 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.616086 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:49.616522 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:49.757855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:49.766214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ba843dfd-50ab-4343-a5f4-4ed7bc1539e7 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1509 microversion: 2.1 time: 0.162253 May 27 03:28:49.766780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 408/789] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:49 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:50.153876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:50.154455 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:50.162201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.162695 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.163440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.163868 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.237454 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:50.246201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-72136deb-3f15-450d-9269-b7141cbc7bc6 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1262 microversion: 2.1 time: 0.096709 May 27 03:28:50.247005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 382/790] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:50 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:50.459013 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:50.459623 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:50.470052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.470752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.471970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.472415 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.619302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:50.631898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fc7bb33d-bccb-4cd7-b090-85a65b26828e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1452 microversion: 2.1 time: 0.178457 May 27 03:28:50.632526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 409/791] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:50 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:50.654167 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:50.655007 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:50.663558 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.664101 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.665408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.666000 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.784173 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:50.784787 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:50.791247 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.791699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.792474 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:50.792912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:50.810338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:50.818460 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-580f7688-ac8b-401c-9440-e0136ae8d7be tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1452 microversion: 2.1 time: 0.170161 May 27 03:28:50.819093 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 383/792] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:50 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:50.932792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:50.941674 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d4db05dc-abeb-4514-9d40-834551571f38 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1509 microversion: 2.1 time: 0.162040 May 27 03:28:50.942272 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 410/793] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:50 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:51.268458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:51.269758 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:51.278012 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:51.279296 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:51.280052 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:51.280488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:51.385058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:51.393060 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-968bb613-9b0f-4b8a-8880-08c813b96f67 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1262 microversion: 2.1 time: 0.130330 May 27 03:28:51.393737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 384/794] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:51 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1262 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:51.959466 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:51.960006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:51.966670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:51.967126 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:51.967885 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:51.968326 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.104161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:52.113097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-13aa6900-7c80-4d45-8f67-5a33a81d7efa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1509 microversion: 2.1 time: 0.157637 May 27 03:28:52.113611 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 411/795] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:51 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:52.410200 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:52.410834 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:52.418613 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.419062 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.419846 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.420277 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.559854 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:52.568178 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cccd3187-71be-4e05-952a-2647015fd583 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1254 microversion: 2.1 time: 0.162086 May 27 03:28:52.568754 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 385/796] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:52 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1254 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:52.911806 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-0a8cff72-f8fd-4017-97b7-ca6c72784739 req-00f4f6d6-b3cd-40b6-8cdc-de3e21476bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbdd423-cd44-475e-abb9-2c765b71b978", "tag": "500f9575-c4a4-47bd-be17-a054e686429b"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:52.920211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-0a8cff72-f8fd-4017-97b7-ca6c72784739 req-00f4f6d6-b3cd-40b6-8cdc-de3e21476bf5 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:52.920665 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-0a8cff72-f8fd-4017-97b7-ca6c72784739 req-00f4f6d6-b3cd-40b6-8cdc-de3e21476bf5 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:52.932369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-0a8cff72-f8fd-4017-97b7-ca6c72784739 req-00f4f6d6-b3cd-40b6-8cdc-de3e21476bf5 service nova] Creating event network-changed:500f9575-c4a4-47bd-be17-a054e686429b for instance 5bbdd423-cd44-475e-abb9-2c765b71b978 on hv-cinder-82880 May 27 03:28:52.937373 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-0a8cff72-f8fd-4017-97b7-ca6c72784739 req-00f4f6d6-b3cd-40b6-8cdc-de3e21476bf5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084623 May 27 03:28:52.937945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 412/797] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:53.131011 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:53.132094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:53.140276 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.142462 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.143469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.144152 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.525232 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:53.533617 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a333ff3a-d23d-4a5b-b175-3831d4b48c9d tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1509 microversion: 2.1 time: 0.406926 May 27 03:28:53.534205 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 386/798] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:53 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:53.547715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-933a04e9-9d9f-46a3-af51-47fbe78e7e05 req-967ec377-ce7c-47f3-a832-4f65130379a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126a653e-c2f9-4fad-9401-b165bddb395d", "name": "network-vif-deleted", "tag": "93f8d1e6-7ba3-465b-83b0-41aabb82cf05"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:28:53.563874 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-933a04e9-9d9f-46a3-af51-47fbe78e7e05 req-967ec377-ce7c-47f3-a832-4f65130379a7 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.564780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-933a04e9-9d9f-46a3-af51-47fbe78e7e05 req-967ec377-ce7c-47f3-a832-4f65130379a7 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.587054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:53.587839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:53.591736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:53.596871 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.597605 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.598707 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:53.599433 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:53.611336 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-933a04e9-9d9f-46a3-af51-47fbe78e7e05 req-967ec377-ce7c-47f3-a832-4f65130379a7 service nova] Creating event network-vif-deleted:93f8d1e6-7ba3-465b-83b0-41aabb82cf05 for instance 126a653e-c2f9-4fad-9401-b165bddb395d on hv-cinder-82880 May 27 03:28:53.639425 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-933a04e9-9d9f-46a3-af51-47fbe78e7e05 req-967ec377-ce7c-47f3-a832-4f65130379a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104203 May 27 03:28:53.640918 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 413/799] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:28:53.755214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:53.768610 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-42b29325-663b-4972-ada9-a243ef65c458 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1316 microversion: 2.1 time: 0.186998 May 27 03:28:53.769576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 387/800] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:53 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:28:54.552647 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:54.553398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:54.573841 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.575558 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.577696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.578593 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.642413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.642861 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.643329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:54.702943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:54.713628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-83979808-c598-4d4c-9fb0-08450bdc2803 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.165409 May 27 03:28:54.714610 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 414/801] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:54 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:54.786731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:54.787248 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:54.793895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.794343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.795102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:54.795531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:54.945338 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:54.953907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2685cbcd-9ed4-43cf-be14-97d58a6db741 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.171629 May 27 03:28:54.954833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 388/802] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:54 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:55.731843 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:55.733301 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:55.740842 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.741407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.742226 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.742736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.776532 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.777112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.777625 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:55.818706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:55.826524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9ad2019f-213c-4cec-85a4-12db20fd3cab tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.098501 May 27 03:28:55.827054 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 415/803] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:55 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:55.973933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:55.975087 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:55.985369 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.985902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:55.986990 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:55.987588 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:56.163451 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:56.171372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-eef48855-b4c9-40c0-9a35-49c565def22f tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.202730 May 27 03:28:56.172193 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 389/804] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:55 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:56.847921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:56.849142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:56.856525 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:56.857080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:56.857906 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:56.858454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:56.902941 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:56.903391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:56.903852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:56.949158 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:56.956772 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4d40a6e9-6eab-44d7-81c9-c63e2744f1b1 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.115398 May 27 03:28:56.957371 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 416/805] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:56 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:57.189639 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:57.190234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:57.196727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:57.197190 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:57.197943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:57.198377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:57.341081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:57.349102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-12fc072d-7cad-4926-9aa2-bc36f841e571 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.163352 May 27 03:28:57.349879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 390/806] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:57 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:57.975279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:57.975936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:57.982987 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:57.983442 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:57.984196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:57.984632 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:58.017050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:58.017527 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:58.017970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:58.067705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:58.075474 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9892647c-65d0-45a6-9ad2-c2527d9b109a tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.104244 May 27 03:28:58.076046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 417/807] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:57 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:58.366307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:58.367432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:58.374117 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:58.374564 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:58.375323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:58.375752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:58.520725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:58.529923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9c9cd983-5731-4bfc-a335-6bf9505c4763 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.167458 May 27 03:28:58.539376 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 391/808] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:58 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:59.094820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:59.096436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:59.104708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:59.106044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:59.107573 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.107968 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.108734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.109282 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.146009 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.146449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.146894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:28:59.192932 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:59.204033 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-98a824a8-89e3-4491-aa46-e293869d1525 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.115602 May 27 03:28:59.204821 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 418/809] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:59 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:28:59.546894 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:28:59.547469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:28:59.549332 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:28:59.561295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.561842 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.563140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:28:59.563628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:28:59.711348 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:28:59.719037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bdecd70b-920d-40f2-8c0c-3062236fd5de tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.176002 May 27 03:28:59.729826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 392/810] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:28:59 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:00.225338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:00.226923 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:00.236589 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.237310 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.238453 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.239044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.272443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.273192 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.273629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:00.319085 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:00.326929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fecf6dcc-3d69-4e73-ab85-2a1a166be2aa tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.107876 May 27 03:29:00.327492 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 419/811] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:00 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:00.597452 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8f839fdb-475b-4fd7-9656-b7b0b148e529 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:00.598054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8f839fdb-475b-4fd7-9656-b7b0b148e529 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:00.604473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f839fdb-475b-4fd7-9656-b7b0b148e529 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.604927 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f839fdb-475b-4fd7-9656-b7b0b148e529 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.605740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f839fdb-475b-4fd7-9656-b7b0b148e529 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.606192 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f839fdb-475b-4fd7-9656-b7b0b148e529 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.633024 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8f839fdb-475b-4fd7-9656-b7b0b148e529 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/ips" status: 200 len: 151 microversion: 2.1 time: 0.139976 May 27 03:29:00.639932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 393/812] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:29:00 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/ips => generated 151 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:00.741084 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:00.743161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:00.750222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.750755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.751595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:00.752101 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:00.926789 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:00.938370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aa5ffcf6-cad8-4e99-965e-dbc293a40bd3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.204435 May 27 03:29:00.939020 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 420/813] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:00 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:01.343641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:01.344287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:01.350575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:01.351163 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:01.352366 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:01.352807 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:01.384680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:01.385149 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:01.385592 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:01.426831 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:01.434793 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b62a5d0d-6ea6-4cf9-9232-46d7cf85e4bb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.094992 May 27 03:29:01.435362 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 394/814] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:01 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:01.959437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:01.960736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:01.973268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:01.973948 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:01.975347 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:01.976359 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:01.980094 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:02.088791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-535e7aba-7dba-42fd-8c13-b79740554f90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d6f6712-e400-45f6-932d-424304585008"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:02.090041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-535e7aba-7dba-42fd-8c13-b79740554f90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:02.097106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-535e7aba-7dba-42fd-8c13-b79740554f90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:02.097638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-535e7aba-7dba-42fd-8c13-b79740554f90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:02.098526 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-535e7aba-7dba-42fd-8c13-b79740554f90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:02.099239 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-535e7aba-7dba-42fd-8c13-b79740554f90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:02.144708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:02.153209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0fdb25bc-b9c3-4116-bb54-627e0a3b0818 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.200195 May 27 03:29:02.153791 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 421/815] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:01 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:02.451750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:02.452393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:02.458485 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:02.458937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:02.459701 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:02.460267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:02.491907 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:02.492348 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:02.492794 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:02.537744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:02.545481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-de4b89b4-6c18-4533-839e-07a2a4373555 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.097599 May 27 03:29:02.546044 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 422/816] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:02 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:03.170690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:03.171437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:03.177982 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.178433 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.179298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.179738 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.335454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:03.343281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0b7346f1-d23d-40c3-985f-40db8793125d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.176522 May 27 03:29:03.346479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 423/817] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:03 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:03.562653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:03.563263 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:03.569445 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.570099 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.570894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.571335 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.601606 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:03.602051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:03.602499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:03.644980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:03.653280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e05dbece-8914-4907-b409-cd92d94d0181 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.094512 May 27 03:29:03.653856 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 424/818] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:03 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:04.361281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:04.363238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:04.370628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:04.371204 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:04.372076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:04.372705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:04.516026 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:04.526653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-94d2db97-2059-42eb-899d-ada4bc7ef5dd tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.169426 May 27 03:29:04.527413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 425/819] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:04 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:04.674463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:04.675438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:04.683643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:04.684091 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:04.684868 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:04.685325 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:04.720908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:04.721455 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:04.722000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:04.769934 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:04.778526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2667518a-2962-40ce-880e-c3ee2a7d2bbb tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.110819 May 27 03:29:04.779400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 426/820] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:04 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:05.551588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:05.552358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:05.562553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.563088 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:05.564259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.564960 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:05.712696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:05.720283 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b8c52805-4bdc-4a5f-b74b-093dcb6f2e8b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.175038 May 27 03:29:05.720862 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 427/821] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:05 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:05.800052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:05.800916 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:05.809497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.809982 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:05.810769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.811242 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:05.849523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:05.850324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:05.851017 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:05.900033 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:05.908908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dbe1dde8-fcd1-4803-8fef-15d2f9352b20 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.114856 May 27 03:29:05.910078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 428/822] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:05 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:06.741916 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:06.743190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:06.750266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:06.750719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:06.751480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:06.751915 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:06.892978 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:06.901777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b5b576e4-da72-47f8-920b-c78eaed65050 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.166756 May 27 03:29:06.902395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 429/823] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:06 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:06.930182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:06.930914 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:06.937878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:06.938418 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:06.939253 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:06.939731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:06.972262 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:06.972773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:06.973258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 126a653e-c2f9-4fad-9401-b165bddb395d {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:07.015427 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:07.023187 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-76261a65-354a-4f9b-a7a4-c932e0ce2f32 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 200 len: 1312 microversion: 2.1 time: 0.097150 May 27 03:29:07.025153 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 430/824] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:06 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:07.407865 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-535e7aba-7dba-42fd-8c13-b79740554f90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.323259 May 27 03:29:07.408813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 395/825] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:29:02 2022] POST /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments => generated 194 bytes in 5325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:07.920255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:07.921580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:07.928511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:07.928976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:07.929775 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:07.931078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.040527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:08.041156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 126a653e-c2f9-4fad-9401-b165bddb395d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:08.052913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.053727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.054907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.055753 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.066960 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:08.081090 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] HTTP exception thrown: Instance 126a653e-c2f9-4fad-9401-b165bddb395d could not be found. May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Request method failure captured: May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d HTTP/1.1 May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQvkgP6dheA1HISWpdWxeiMUoVKTOpvwrpfLG-ikSRwPw6Oq6pJowRRCtPYOjlAZkPx6l1XfuLMN1XJmMcVOfiQL4cYiJx5ijWcOp_OLv9lVLF8Xf_ooNsu_C-fVamGPpIZtMPA-zLDtioWYSFm6PMhCcJi0NjCRk6CyajVkFIWqV0 May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:29:08.083532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 468a46d55bd342739b9cd78bcd3a77fc May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 126a653e-c2f9-4fad-9401-b165bddb395d could not be found. May 27 03:29:08.085488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '126a653e-c2f9-4fad-9401-b165bddb395d'} May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126a653e-c2f9-4fad-9401-b165bddb395d could not be found. May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:08.086575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126a653e-c2f9-4fad-9401-b165bddb395d could not be found. May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126a653e-c2f9-4fad-9401-b165bddb395d could not be found. May 27 03:29:08.088583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:08.089777 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Returning 404 to user: Instance 126a653e-c2f9-4fad-9401-b165bddb395d could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:08.089777 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d624d782-6ee1-4182-a0d4-ae0fa0be3681 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d" status: 404 len: 111 microversion: 2.1 time: 0.050497 May 27 03:29:08.089777 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 396/826] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:08 2022] GET /compute/v2.1/servers/126a653e-c2f9-4fad-9401-b165bddb395d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:08.094439 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-fc159091-cb72-4573-b80b-a99796c1077a req-69b49315-f8eb-4452-a748-4a17ee807a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70020c76-0cc4-4adf-985d-4bd2c1b6b0da", "tag": "bac56807-d1e8-4e80-8e99-25b19600d119"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:08.110838 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:08.114027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-fc159091-cb72-4573-b80b-a99796c1077a req-69b49315-f8eb-4452-a748-4a17ee807a5b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.114511 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-fc159091-cb72-4573-b80b-a99796c1077a req-69b49315-f8eb-4452-a748-4a17ee807a5b service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.120613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-af332e16-12af-4f73-93a8-b3c18d6135f4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.204569 May 27 03:29:08.121838 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 431/827] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:07 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:08.128003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:08.128769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:08.135881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.136638 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.137695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.138528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.139939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-fc159091-cb72-4573-b80b-a99796c1077a req-69b49315-f8eb-4452-a748-4a17ee807a5b service nova] Creating event network-changed:bac56807-d1e8-4e80-8e99-25b19600d119 for instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da on hv-cinder-82880 May 27 03:29:08.146513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-fc159091-cb72-4573-b80b-a99796c1077a req-69b49315-f8eb-4452-a748-4a17ee807a5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055654 May 27 03:29:08.147424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 397/828] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:08.169737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:29:08.267844 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-11341869-97b1-41ba-abc7-ce695617dde8 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 204 len: 0 microversion: 2.1 time: 0.144520 May 27 03:29:08.271647 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 432/829] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:29:08 2022] DELETE /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:08.280887 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:08.281607 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:08.287963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.288403 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.289425 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:08.289974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:08.423492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:08.431287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-872155e5-20b2-4232-a619-27ca35b6f865 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.158150 May 27 03:29:08.431849 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 398/830] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:08 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:09.138149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:09.138883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:09.145986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:09.146439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:09.147208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:09.147673 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:09.285665 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:09.293836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c4c46478-64ea-40f1-ae7a-10a9007d5682 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.160329 May 27 03:29:09.294409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 433/831] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:09 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:09.451777 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:09.452762 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:09.464017 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:09.464771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:09.466113 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:09.466850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:09.609923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:09.621499 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3925f7a4-bcf2-4b29-8aec-b91d1d0b55c4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.175954 May 27 03:29:09.622315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 399/832] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:09 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:10.312643 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:10.313275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:10.320583 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:10.320981 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:10.321762 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:10.322199 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:10.337907 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:10.454892 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:10.462969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0b4d73d7-04d8-4ef4-9f10-db61d1696258 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.154325 May 27 03:29:10.463585 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 434/833] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:10 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:10.645273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:10.645870 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:10.652844 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:10.653333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:10.654100 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:10.654515 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:10.950473 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:10.962743 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-68bf224f-8b7f-464c-b6c0-68b129a0959c tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1522 microversion: 2.1 time: 0.321105 May 27 03:29:10.963745 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 400/834] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:10 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:11.481857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:11.482497 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:11.489357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.489717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.490517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.490951 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.645503 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:11.655151 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ab588f0c-b6fa-4308-b6d3-a3c710faa155 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.178839 May 27 03:29:11.656110 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 435/835] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:11 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:11.768709 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d6f6712-e400-45f6-932d-424304585008"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:11.769839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:11.776396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.776856 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.777664 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.778136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.862351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Invalid volume: volume 3d6f6712-e400-45f6-932d-424304585008 is already attached to instances: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: POST /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments HTTP/1.1 May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 74 May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:29:11.864335 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {"volumeAttachment": {"volumeId": "3d6f6712-e400-45f6-932d-424304585008"}} May 27 03:29:11.865902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Invalid volume: volume 3d6f6712-e400-45f6-932d-424304585008 is already attached to instances: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'server_id': '9d25eaff-39bb-4434-848b-7b2dcc68d1e9', 'body': {'volumeAttachment': {'volumeId': '3d6f6712-e400-45f6-932d-424304585008'}}} May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3d6f6712-e400-45f6-932d-424304585008 is already attached to instances: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:11.866629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3d6f6712-e400-45f6-932d-424304585008 is already attached to instances: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:11.867839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3d6f6712-e400-45f6-932d-424304585008 is already attached to instances: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 400 to user: Invalid volume: volume 3d6f6712-e400-45f6-932d-424304585008 is already attached to instances: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-abe28dad-fb5e-4e4f-84a5-0eb2c7e9d919 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101010 May 27 03:29:11.869273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 401/836] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:29:11 2022] POST /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:29:11.947458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:11.948254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:11.957959 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.958422 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.959234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.959672 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.960936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6ff19a0b-97c6-43ef-9233-7118d0539be7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:11.961876 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6ff19a0b-97c6-43ef-9233-7118d0539be7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:11.969584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ff19a0b-97c6-43ef-9233-7118d0539be7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.970337 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ff19a0b-97c6-43ef-9233-7118d0539be7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:11.971364 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ff19a0b-97c6-43ef-9233-7118d0539be7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:11.972113 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ff19a0b-97c6-43ef-9233-7118d0539be7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.011767 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6ff19a0b-97c6-43ef-9233-7118d0539be7 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/ips" status: 200 len: 151 microversion: 2.20 time: 0.177598 May 27 03:29:12.018730 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 436/837] 10.222.0.50 () {60 vars in 1288 bytes} [Fri May 27 03:29:11 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/ips => generated 151 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:29:12.027179 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:12.027982 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:12.039198 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:12.040004 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.041185 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:12.042025 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.075963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lazy-loading 'services' on Instance uuid 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:12.108477 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:12.116792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0b9b3e15-f0c6-4468-967d-91f61f0979b4 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1480 microversion: 2.1 time: 0.096773 May 27 03:29:12.117636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 437/838] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:12 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1480 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:12.123111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-3a94adeb-b252-473d-91da-f83211535855 req-f26f0c22-e4fb-4979-bf3a-4beb2160263a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0b7be0-94f6-463c-ae31-1fdb017d059a", "name": "network-vif-deleted", "tag": "6d9acc3b-ba55-4e78-9bbb-cb5a5ce850ef"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:12.132246 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-3a94adeb-b252-473d-91da-f83211535855 req-f26f0c22-e4fb-4979-bf3a-4beb2160263a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:12.132966 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-3a94adeb-b252-473d-91da-f83211535855 req-f26f0c22-e4fb-4979-bf3a-4beb2160263a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.146694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-3a94adeb-b252-473d-91da-f83211535855 req-f26f0c22-e4fb-4979-bf3a-4beb2160263a service nova] Creating event network-vif-deleted:6d9acc3b-ba55-4e78-9bbb-cb5a5ce850ef for instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a on hv-cinder-82880 May 27 03:29:12.152261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-3a94adeb-b252-473d-91da-f83211535855 req-f26f0c22-e4fb-4979-bf3a-4beb2160263a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033150 May 27 03:29:12.152937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 438/839] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:12.157294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a399d9ef-7b47-4878-b125-b4f3c58c2d65 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments/3d6f6712-e400-45f6-932d-424304585008" status: 202 len: 0 microversion: 2.1 time: 0.214283 May 27 03:29:12.157970 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 402/840] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:29:11 2022] DELETE /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments/3d6f6712-e400-45f6-932d-424304585008 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:29:12.167722 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-82fce381-37c0-4ac3-b56b-bc7f2bf2e9f6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:12.168878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-82fce381-37c0-4ac3-b56b-bc7f2bf2e9f6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:12.171357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:12.176640 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82fce381-37c0-4ac3-b56b-bc7f2bf2e9f6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:12.177201 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82fce381-37c0-4ac3-b56b-bc7f2bf2e9f6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.178024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82fce381-37c0-4ac3-b56b-bc7f2bf2e9f6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:12.178522 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-82fce381-37c0-4ac3-b56b-bc7f2bf2e9f6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.210621 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-82fce381-37c0-4ac3-b56b-bc7f2bf2e9f6 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048079 May 27 03:29:12.211411 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 439/841] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:29:12 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:12.677044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:12.678229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:12.686442 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:12.686897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.687671 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:12.688108 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:12.836607 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:12.844904 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f87dfa12-2f9e-4950-9e6c-c53568fe4c5d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.174974 May 27 03:29:12.845489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 403/842] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:12 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:13.137507 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:13.138052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:13.144938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:13.145454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:13.146234 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:13.146675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:13.218005 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:13.225486 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2c67db6-07b8-4873-aaed-c5d797c0c5ad tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:13.228140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d9df91ae-ee57-4ec1-9f52-91208ac13752 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1307 microversion: 2.1 time: 0.095944 May 27 03:29:13.229691 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 440/843] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:13 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:13.232118 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c2c67db6-07b8-4873-aaed-c5d797c0c5ad tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:13.244499 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2c67db6-07b8-4873-aaed-c5d797c0c5ad tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:13.245387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2c67db6-07b8-4873-aaed-c5d797c0c5ad tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:13.245845 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2c67db6-07b8-4873-aaed-c5d797c0c5ad tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:13.246251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2c67db6-07b8-4873-aaed-c5d797c0c5ad tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:13.308071 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c2c67db6-07b8-4873-aaed-c5d797c0c5ad tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086713 May 27 03:29:13.311453 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 404/844] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:29:13 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:13.865923 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:13.866922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:13.877922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:13.878674 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:13.879933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:13.880671 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.023509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:14.034428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7b625890-40ce-4e08-a3f4-d62b01b83414 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.174807 May 27 03:29:14.035062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 441/845] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:13 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:14.179500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:14.180115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:14.187281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.187736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.188512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.188943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.217987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lazy-loading 'flavor' on Instance uuid 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:14.245375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:14.245981 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:14.252513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.252990 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.253757 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.254198 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.294166 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.294929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.295535 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lazy-loading 'fault' on Instance uuid 8c0b7be0-94f6-463c-ae31-1fdb017d059a {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:14.354266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468a46d55bd342739b9cd78bcd3a77fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db8193dcee944008c7b41889bfa67a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:14.362278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-21c6ee12-4387-464c-ab11-bc6e6a60ae48 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 200 len: 1312 microversion: 2.1 time: 0.121127 May 27 03:29:14.363266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 442/846] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:14 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 1312 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:14.368256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7afe2b67-6322-4a92-a86b-e53d4ae888d9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:14.369913 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7afe2b67-6322-4a92-a86b-e53d4ae888d9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:14.382919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7afe2b67-6322-4a92-a86b-e53d4ae888d9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.383764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7afe2b67-6322-4a92-a86b-e53d4ae888d9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.384844 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7afe2b67-6322-4a92-a86b-e53d4ae888d9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.385666 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7afe2b67-6322-4a92-a86b-e53d4ae888d9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.421525 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7afe2b67-6322-4a92-a86b-e53d4ae888d9 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056911 May 27 03:29:14.422174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 443/847] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:29:14 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:14.545191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f31e6302-79b6-4256-adf8-ae61dbf80cf8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/action" status: 202 len: 0 microversion: 2.20 time: 0.369443 May 27 03:29:14.545833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 405/848] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 03:29:14 2022] POST /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:14.555815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:14.556498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:14.563650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.563650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.564385 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:14.565602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:14.711298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:14.720077 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:14.721613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:14.722804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7dc124e2-ef9c-444e-a5f7-958cabd00526 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.172429 May 27 03:29:14.723374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 444/849] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:14 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:15.056609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.057355 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.064265 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.064714 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.065519 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.065960 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.216495 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:15.227903 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-399e24ba-b1e8-477b-9180-9871d74a6f1d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.177248 May 27 03:29:15.228641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 406/850] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:15 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:15.385483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.386115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] [instance: 8c0b7be0-94f6-463c-ae31-1fdb017d059a] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.392832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.393368 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.394142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.394737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.408802 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] HTTP exception thrown: Instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a could not be found. May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Request method failure captured: May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a HTTP/1.1 May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQvkgP6dheA1HISWpdWxeiMUoVKTOpvwrpfLG-ikSRwPw6Oq6pJowRRCtPYOjlAZkPx6l1XfuLMN1XJmMcVOfiQL4cYiJx5ijWcOp_OLv9lVLF8Xf_ooNsu_C-fVamGPpIZtMPA-zLDtioWYSFm6PMhCcJi0NjCRk6CyajVkFIWqV0 May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:29:15.410636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6db8193dcee944008c7b41889bfa67a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 6db8193dcee944008c7b41889bfa67a3 May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-568556180 May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 468a46d55bd342739b9cd78bcd3a77fc May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-568556180-project May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a could not be found. May 27 03:29:15.412472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '8c0b7be0-94f6-463c-ae31-1fdb017d059a'} May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a could not be found. May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:15.413298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a could not be found. May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a could not be found. May 27 03:29:15.414551 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:29:15.415650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] Returning 404 to user: Instance 8c0b7be0-94f6-463c-ae31-1fdb017d059a could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:15.415650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-00c19eaf-a85b-4e12-9825-9cc36ab0f715 tempest-ServerRescueNegativeTestJSON-568556180 tempest-ServerRescueNegativeTestJSON-568556180-project] 10.222.0.50 "GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a" status: 404 len: 111 microversion: 2.1 time: 0.033237 May 27 03:29:15.415650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 445/851] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:15 2022] GET /compute/v2.1/servers/8c0b7be0-94f6-463c-ae31-1fdb017d059a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:15.435323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1f819a74-89ac-46fc-aa33-9c344f3e631f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.436567 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1f819a74-89ac-46fc-aa33-9c344f3e631f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.443395 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f819a74-89ac-46fc-aa33-9c344f3e631f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.443763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f819a74-89ac-46fc-aa33-9c344f3e631f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.444857 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f819a74-89ac-46fc-aa33-9c344f3e631f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.445332 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f819a74-89ac-46fc-aa33-9c344f3e631f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.475367 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1f819a74-89ac-46fc-aa33-9c344f3e631f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045523 May 27 03:29:15.476201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 407/852] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:29:15 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:29:15.538552 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.539146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.547464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.548076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.548960 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.549528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.575642 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:29:15.670177 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7e312188-df20-415e-8c85-868cd5b0f9f1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 204 len: 0 microversion: 2.1 time: 0.134947 May 27 03:29:15.674174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 446/853] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:29:15 2022] DELETE /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:15.679697 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.680325 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.686563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.687014 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.687793 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.688229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.742924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:15.743682 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:15.749934 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.750386 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.751161 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:15.751598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:15.891835 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:15.900327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:15.901718 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:15.902904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-593dc944-dc57-4650-a369-91bbfc01c0fa tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.164418 May 27 03:29:15.903470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 447/854] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:15 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:15.925993 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:15.934136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-801f34b0-bc87-485f-a246-847e86c8fdbb tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1682 microversion: 2.1 time: 0.258547 May 27 03:29:15.934757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 408/855] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:15 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1682 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:16.244655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:16.245365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:16.251911 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.252360 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:16.253182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.253624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:16.385810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:16.393469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-64d296b5-f85a-47a5-9764-52833d686383 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.152843 May 27 03:29:16.394039 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 448/856] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:16 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:16.922369 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:16.923046 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:16.929804 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.930251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:16.931015 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.931591 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:16.952694 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:16.953806 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:16.960262 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.961258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:16.962029 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:16.962461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:17.098045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:17.106443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1f421957-8fec-48a0-a817-4b5e6de4469f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1682 microversion: 2.1 time: 0.157688 May 27 03:29:17.107021 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 449/857] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:16 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:17.151171 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:17.159280 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:17.160789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:17.161942 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-157517c3-4efc-4ca6-869f-5cf3949dd4bd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.244067 May 27 03:29:17.163490 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 409/858] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:16 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:17.410766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:17.411493 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:17.421655 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:17.422188 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:17.423453 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:17.423950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:17.662809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:17.674294 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:17.678404 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eea84858-6909-48b2-a47c-7e7390caa19a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.270916 May 27 03:29:17.679998 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 450/859] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:17 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:17.910555 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-04d4404c-e223-49db-b6f7-b9bdde5c08b4 req-e1e8f95b-3a5a-4b88-a9dc-09b457b6cb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70020c76-0cc4-4adf-985d-4bd2c1b6b0da", "name": "network-vif-plugged", "status": "completed", "tag": "bac56807-d1e8-4e80-8e99-25b19600d119"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:17.919716 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-04d4404c-e223-49db-b6f7-b9bdde5c08b4 req-e1e8f95b-3a5a-4b88-a9dc-09b457b6cb19 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:17.920135 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-04d4404c-e223-49db-b6f7-b9bdde5c08b4 req-e1e8f95b-3a5a-4b88-a9dc-09b457b6cb19 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:17.933217 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-04d4404c-e223-49db-b6f7-b9bdde5c08b4 req-e1e8f95b-3a5a-4b88-a9dc-09b457b6cb19 service nova] Creating event network-vif-plugged:bac56807-d1e8-4e80-8e99-25b19600d119 for instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da on hv-cinder-82880 May 27 03:29:17.939076 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-04d4404c-e223-49db-b6f7-b9bdde5c08b4 req-e1e8f95b-3a5a-4b88-a9dc-09b457b6cb19 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112248 May 27 03:29:17.939876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 410/860] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:18.126973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:18.127498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:18.149994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.151539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.152550 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.153017 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.185433 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:18.186315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:18.202768 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.204676 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.205564 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.206009 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.413644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:18.424101 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e52afe93-5084-4fb0-85ab-3244bfa0666a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1615 microversion: 2.1 time: 0.301517 May 27 03:29:18.424904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 451/861] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:18 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1615 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:18.703557 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:18.704188 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:18.733990 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.735256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.736122 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:18.736567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:18.754325 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:18.767626 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:18.773797 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:18.783989 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-74cdd6cf-2e13-43e3-a055-b9069cae01ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.604080 May 27 03:29:18.796528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 411/862] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:18 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:18.998286 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:19.011413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-da5e1c38-6186-41b3-befc-f0651b385edb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1358 microversion: 2.1 time: 0.317690 May 27 03:29:19.012014 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 452/863] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:18 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:19.047895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-693cfbe6-0708-4dd7-9012-28e12264141c req-c0841e70-638a-4423-9757-aa78111caf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d25eaff-39bb-4434-848b-7b2dcc68d1e9", "name": "network-vif-deleted", "tag": "7548807f-da0a-4e25-9317-457dbf196bc6"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:19.064026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-693cfbe6-0708-4dd7-9012-28e12264141c req-c0841e70-638a-4423-9757-aa78111caf8d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.064477 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-693cfbe6-0708-4dd7-9012-28e12264141c req-c0841e70-638a-4423-9757-aa78111caf8d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:19.081703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:19.084022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-693cfbe6-0708-4dd7-9012-28e12264141c req-c0841e70-638a-4423-9757-aa78111caf8d service nova] Creating event network-vif-deleted:7548807f-da0a-4e25-9317-457dbf196bc6 for instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 on hv-cinder-82880 May 27 03:29:19.091068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-693cfbe6-0708-4dd7-9012-28e12264141c req-c0841e70-638a-4423-9757-aa78111caf8d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047670 May 27 03:29:19.096343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 412/864] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:19.444396 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:19.445052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:19.457602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.458734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:19.459979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.460428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:19.497684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.498135 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:19.499032 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lazy-loading 'fault' on Instance uuid 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:19.570211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:19.584261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cc160f4a-aa06-41db-8918-05ed702df5a7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 200 len: 1331 microversion: 2.1 time: 0.142482 May 27 03:29:19.584261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 453/865] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:19 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:19.805056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:19.805953 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:19.813669 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.814211 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:19.815184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:19.815728 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.000269 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.013063 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.015535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.017747 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4f5ced66-57e8-4b4d-b935-147030599830 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.218031 May 27 03:29:20.019058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 413/866] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:19 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:20.028308 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.028837 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:20.038705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.039666 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.040542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.041576 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.203341 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.211324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-97279e1a-d900-42ba-91e7-9b4dd5a961af tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1548 microversion: 2.1 time: 0.187463 May 27 03:29:20.212115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 454/867] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:20.232441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.233082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:20.240261 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.240929 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.242260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.242712 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.398893 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.413371 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d06abbe7-8523-4df2-896d-87df02a7f3d9 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1548 microversion: 2.1 time: 0.183466 May 27 03:29:20.413371 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 414/868] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:20.431830 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.443973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.445111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Searching by: {'deleted': False, 'project_id': 'f03723b938b845309929162c81adfe51'} {{(pid=117766) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 03:29:20.460088 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.460481 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.461319 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.461850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.572878 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.multi_cell_list [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117766) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 03:29:20.600888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.601747 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:20.610249 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.610775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.611731 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.618975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.643234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 HTTP/1.1 May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:29:20.645045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:29:20.646493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '9d25eaff-39bb-4434-848b-7b2dcc68d1e9'} May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:29:20.647331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:29:20.648722 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:29:20.651899 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:29:20.654081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d7f72211-aa88-4d33-a272-8871233adea4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 404 len: 111 microversion: 2.1 time: 0.057096 May 27 03:29:20.654649 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 415/869] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:29:20.663763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d7605526-aed4-4cb6-a865-f675027dced3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '.version_select at 0x7f5e74026e50>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.686879 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d7605526-aed4-4cb6-a865-f675027dced3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602726710" status: 202 len: 0 microversion: 2.1 time: 0.027643 May 27 03:29:20.687628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 416/870] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 03:29:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602726710 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:29:20.710520 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a440ed07-1db3-4bf3-92bb-61b868b98b08 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.284656 May 27 03:29:20.711367 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 455/871] 10.222.0.50 () {58 vars in 1124 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:29:20.722323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:20.723133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:20.731312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.731771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.732608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:20.733293 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:20.909326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:20.918179 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d2d5b12a-9e26-45a0-8e7e-6a51b4766731 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1548 microversion: 2.1 time: 0.200238 May 27 03:29:20.918752 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 417/872] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:20 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:21.037982 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:21.039484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:21.048580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:21.049766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:21.051416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:21.052759 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:21.313560 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:21.327031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:21.328543 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:21.329870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-450b4b94-03d5-47e3-bae9-d28ca49c7d32 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.298160 May 27 03:29:21.331011 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 456/873] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:21 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:21.485128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fffa5b9f-cdf6-4e21-9fd7-8f95f5797ee7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: .version_select at 0x7f5e6f7abd30>, body: {"keypair": {"name": "tempest-keypair-186588876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNqoHVRTgZIssKANTduhXXnkOi5Xs/foQREY9NdcXVGAMX4Upr1gn9+KJLYfD295uNCwRSFf9C7XPT5XMUtdrLm3L6mip1AzS/2DqoGJg+hgkP3MhfcFBGqqCo6MWwQoA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:21.499779 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fffa5b9f-cdf6-4e21-9fd7-8f95f5797ee7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:29:21.503772 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fffa5b9f-cdf6-4e21-9fd7-8f95f5797ee7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:29:21.529358 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fffa5b9f-cdf6-4e21-9fd7-8f95f5797ee7 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048027 May 27 03:29:21.530556 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 418/874] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:29:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:22.349011 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:22.349660 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:22.356528 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:22.357015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:22.357786 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:22.358220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:22.573986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:22.583366 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:22.584874 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:22.586153 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bebb5224-a6a7-4641-9ad4-a2ac4a306c73 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.241107 May 27 03:29:22.591776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 457/875] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:22 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:22.706315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e118dbe-f44b-4ff9-98ac-9f20fa87a836 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6758a74-625e-46e7-8b23-fbf9c1b75651"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:22.707462 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9e118dbe-f44b-4ff9-98ac-9f20fa87a836 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:22.714634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e118dbe-f44b-4ff9-98ac-9f20fa87a836 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:22.715158 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e118dbe-f44b-4ff9-98ac-9f20fa87a836 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:22.715996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e118dbe-f44b-4ff9-98ac-9f20fa87a836 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:22.716496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e118dbe-f44b-4ff9-98ac-9f20fa87a836 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:23.000502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e118dbe-f44b-4ff9-98ac-9f20fa87a836 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298682 May 27 03:29:23.001191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 419/876] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:29:22 2022] POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:23.027022 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-17066849", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e861f168-e1a5-4542-8ee4-9759fa17a578"}], "security_groups": [{"name": "tempest-securitygroup--1489619846"}], "key_name": "tempest-keypair-186588876", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:23.138893 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] validate_networks() for [('e861f168-e1a5-4542-8ee4-9759fa17a578', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:29:23.535045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:29:23.535644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:29:23.535930 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:29:23.536340 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:29:23.536776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:29:23.546717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:23.547165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:23.547963 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:23.548395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:23.565436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:29:23.569612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Getting quotas for user a094273e734342eca2bdf159fab8a8d2 and project 082b5523ee504be09f6fcaf833207a4f. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:29:23.581428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:29:23.583706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:29:23.606077 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:23.606773 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:23.613236 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:23.613937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:23.614734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:23.615178 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:23.631205 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5c29158e-03f2-44f2-ba37-38e7e3069936 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.608753 May 27 03:29:23.632490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 458/877] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:29:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:29:23.643416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c5b7d659-7f34-4ca0-8ed7-c9cdd6340e84 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:23.644465 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c5b7d659-7f34-4ca0-8ed7-c9cdd6340e84 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:23.701501 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c5b7d659-7f34-4ca0-8ed7-c9cdd6340e84 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:23.709334 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c5b7d659-7f34-4ca0-8ed7-c9cdd6340e84 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1239 microversion: 2.1 time: 0.069885 May 27 03:29:23.710087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 459/878] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:23 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:23.756994 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:23.765951 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:23.767448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:23.768584 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8c7eeee7-d3ba-49a1-8d20-ef3208441c08 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.167399 May 27 03:29:23.769154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 420/879] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:23 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:24.725605 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:24.726884 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:24.733818 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:24.734243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:24.735176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:24.735605 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:24.786993 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:24.787738 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:24.791683 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:24.813581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:24.814051 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:24.815174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:24.815926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:24.830845 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:24.839857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8d9feefa-92ed-4fad-a577-53e0be1a8af8 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1299 microversion: 2.1 time: 0.118070 May 27 03:29:24.840526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 460/880] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:24 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:25.049554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:25.059037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:25.060563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:25.062250 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e83d9f2-13a1-4bb4-9380-ad0f1c615a1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.279746 May 27 03:29:25.065111 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 421/881] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:24 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:25.247061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-15dc4b6a-86a4-4edb-adfa-1f2fd85ddcc7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:25.247713 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-15dc4b6a-86a4-4edb-adfa-1f2fd85ddcc7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:25.256498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-15dc4b6a-86a4-4edb-adfa-1f2fd85ddcc7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.257211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-15dc4b6a-86a4-4edb-adfa-1f2fd85ddcc7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:25.258486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-15dc4b6a-86a4-4edb-adfa-1f2fd85ddcc7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.259153 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-15dc4b6a-86a4-4edb-adfa-1f2fd85ddcc7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:25.285959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-15dc4b6a-86a4-4edb-adfa-1f2fd85ddcc7 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/ips" status: 200 len: 144 microversion: 2.1 time: 0.045455 May 27 03:29:25.286545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 461/882] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:29:25 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:25.857707 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:25.858321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:25.865484 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.865940 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:25.866746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:25.867188 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:26.003543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:26.011877 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1daa32c5-6a61-499e-8a79-7cfc753e7f34 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.158322 May 27 03:29:26.012454 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 422/883] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:25 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:26.080203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:26.080822 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:26.089470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:26.089994 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:26.090774 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:26.091201 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:26.232479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:26.240820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:26.244355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:26.244355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-21224b52-2a6b-42cc-ac8f-83bad14e0298 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.167484 May 27 03:29:26.244355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 462/884] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:26 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:27.032684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:27.033686 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:27.043647 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.044097 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.044910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.045381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.186357 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.194078 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8efa2579-7f4f-4545-8e05-889aa5fa5f81 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.167629 May 27 03:29:27.194880 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 423/885] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:27 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:27.261877 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:27.262501 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:27.269407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.270012 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.270793 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:27.271199 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:27.408751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.421188 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.423511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:27.425283 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-61dfc5fa-c47b-44d9-8fcf-d7c4f4fefde0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.167419 May 27 03:29:27.426000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 463/886] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:27 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:28.211557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:28.212155 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:28.220314 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.220770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.221580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.222186 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.444241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:28.445092 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:28.452342 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.452879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.454009 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.454545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.478186 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.498323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2e554347-7af2-425d-9bc1-b09a4d9dd66b tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.289254 May 27 03:29:28.499290 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 424/887] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:28 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:28.504646 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-b091934e-e460-4606-8bfd-20dc3ca2a410 req-4133b6f8-dcdd-4c9d-8b9e-238b246d793f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0e8bee-579d-4c69-b1cb-516d6216e089", "tag": "72e619f9-cc36-4b46-b89f-a4af82c97aa9"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:28.517209 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-b091934e-e460-4606-8bfd-20dc3ca2a410 req-4133b6f8-dcdd-4c9d-8b9e-238b246d793f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.517948 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-b091934e-e460-4606-8bfd-20dc3ca2a410 req-4133b6f8-dcdd-4c9d-8b9e-238b246d793f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.530565 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-b091934e-e460-4606-8bfd-20dc3ca2a410 req-4133b6f8-dcdd-4c9d-8b9e-238b246d793f service nova] Creating event network-changed:72e619f9-cc36-4b46-b89f-a4af82c97aa9 for instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 on hv-cinder-82880 May 27 03:29:28.535699 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-b091934e-e460-4606-8bfd-20dc3ca2a410 req-4133b6f8-dcdd-4c9d-8b9e-238b246d793f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034571 May 27 03:29:28.536819 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 425/888] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:28.630151 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.639865 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.641670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:28.643160 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ba081377-72fa-4733-a0d4-ba1a30533cb9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.203231 May 27 03:29:28.645143 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 464/889] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:28 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:28.728463 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0a49bf86-af4b-4590-b01d-d06044bfca89 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21243f1a-fab3-4268-8713-e1fa62cc3ef1"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:28.729742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0a49bf86-af4b-4590-b01d-d06044bfca89 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:28.736231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a49bf86-af4b-4590-b01d-d06044bfca89 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.736682 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a49bf86-af4b-4590-b01d-d06044bfca89 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:28.737489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a49bf86-af4b-4590-b01d-d06044bfca89 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:28.737923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a49bf86-af4b-4590-b01d-d06044bfca89 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.035899 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0a49bf86-af4b-4590-b01d-d06044bfca89 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311570 May 27 03:29:29.036428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 426/890] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:29:28 2022] POST /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:29.515705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:29.516315 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:29.523250 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.523695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.524449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.524901 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.662036 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:29.662737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:29.664321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:29.669581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.669750 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.670472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:29.670906 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:29.674154 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0dcdaa87-aa9f-48e8-85c1-3771acc05f4d tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.162319 May 27 03:29:29.675197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 465/891] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:29 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:29.804160 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:29.814230 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:29.815736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:29.816935 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-102826b7-a6f7-4ca4-89e3-45a73f7c1098 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.159772 May 27 03:29:29.817523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 427/892] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:29 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:30.700351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:30.700933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:30.708146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:30.708701 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:30.709540 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:30.710595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:30.837180 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:30.839311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:30.863745 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:30.864123 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:30.864937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:30.868282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:30.888373 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:30.903654 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a5289be1-3f8b-430d-9115-714951a1c7b2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.206016 May 27 03:29:30.907448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 466/893] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:30 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:31.140720 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:31.149531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:31.151223 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:31.152207 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cfb1f2d6-23ed-41ff-8ecb-713109c95458 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.319593 May 27 03:29:31.152916 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 428/894] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:30 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:31.812719 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:31.813369 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:31.820194 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.820667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.821475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.821912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.924336 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:31.925128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:31.927868 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:31.933702 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.934157 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.934943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:31.936156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:31.956649 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:31.966142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33cf08cc-f061-4fe1-9b77-68473de1f4ca tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1594 microversion: 2.1 time: 0.157475 May 27 03:29:31.967003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 467/895] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:31 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:32.078996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.088190 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-297c38ea-8e0c-4a94-841d-c2a4487cf4c3 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.168291 May 27 03:29:32.089302 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 429/896] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:31 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:32.169886 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:32.170538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:32.176580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:32.177145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:32.177949 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:32.178390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:32.393229 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.397953 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:32.404146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.406081 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:32.408031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-650ec922-0cd8-4717-89f1-021d8895ee9a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.241877 May 27 03:29:32.409626 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 468/897] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:32 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:33.105350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:33.105928 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:33.114139 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.114632 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.116208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.116908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.122904 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:33.260183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.268502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-80a8a8ea-2052-4005-b089-b8aee296acac tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.166986 May 27 03:29:33.281914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 430/898] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:33 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:33.427946 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:33.429644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:33.445231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.446070 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.447045 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.447653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:33.556167 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:33.706226 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=8 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:33.755621 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.769407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.773686 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:33.775689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9e27811c-4339-4b8b-baa3-662c52f95759 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.352674 May 27 03:29:33.776642 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 469/899] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:33 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:33.978077 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-2846ba57-e677-4de0-b98b-d325a0c49b21 req-76e91afa-f3a0-4690-ad7e-cf46f6721121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0e8bee-579d-4c69-b1cb-516d6216e089", "name": "network-vif-plugged", "status": "completed", "tag": "72e619f9-cc36-4b46-b89f-a4af82c97aa9"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:33.988932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2846ba57-e677-4de0-b98b-d325a0c49b21 req-76e91afa-f3a0-4690-ad7e-cf46f6721121 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:33.989431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2846ba57-e677-4de0-b98b-d325a0c49b21 req-76e91afa-f3a0-4690-ad7e-cf46f6721121 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.002808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-2846ba57-e677-4de0-b98b-d325a0c49b21 req-76e91afa-f3a0-4690-ad7e-cf46f6721121 service nova] Creating event network-vif-plugged:72e619f9-cc36-4b46-b89f-a4af82c97aa9 for instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 on hv-cinder-82880 May 27 03:29:34.009847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-2846ba57-e677-4de0-b98b-d325a0c49b21 req-76e91afa-f3a0-4690-ad7e-cf46f6721121 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035496 May 27 03:29:34.010459 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 431/900] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:34.292708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:34.301047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:34.310321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.311473 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.312049 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.312176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.540616 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-e3d76103-a0f7-40f6-afd7-d5e61fd47d4d req-81387c1a-93a0-422b-8f72-0b24c1ffc4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70020c76-0cc4-4adf-985d-4bd2c1b6b0da", "tag": "bac56807-d1e8-4e80-8e99-25b19600d119"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:34.566165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:34.577005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e3d76103-a0f7-40f6-afd7-d5e61fd47d4d req-81387c1a-93a0-422b-8f72-0b24c1ffc4f9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.578887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1a5382c6-4b8e-4642-9d81-7edc54ddb5d4 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.293797 May 27 03:29:34.580281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e3d76103-a0f7-40f6-afd7-d5e61fd47d4d req-81387c1a-93a0-422b-8f72-0b24c1ffc4f9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.581348 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 470/901] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:34 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:34.593016 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-e3d76103-a0f7-40f6-afd7-d5e61fd47d4d req-81387c1a-93a0-422b-8f72-0b24c1ffc4f9 service nova] Creating event network-changed:bac56807-d1e8-4e80-8e99-25b19600d119 for instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da on hv-cinder-82880 May 27 03:29:34.598726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-e3d76103-a0f7-40f6-afd7-d5e61fd47d4d req-81387c1a-93a0-422b-8f72-0b24c1ffc4f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063456 May 27 03:29:34.599457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 432/902] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:34.803665 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:34.804281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:34.812215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.813031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:34.814111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:34.814861 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:35.067280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:35.084142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:35.087332 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:35.089420 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5fa89750-7c3a-4140-b00a-dab649183b97 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.289716 May 27 03:29:35.090684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 471/903] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:34 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:35.598536 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:35.599809 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:35.607508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:35.608285 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:35.609412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:35.610162 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:35.778908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-865430063"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:35.779524 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:35.793913 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:35.795080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:35.796410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:35.796855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:35.805999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:35.814492 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-765a5b5e-5104-480c-beba-645d8973c46f tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1365 microversion: 2.1 time: 0.220460 May 27 03:29:35.815724 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 433/904] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:35 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:35.968382 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.network.security_group_api [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Adding security group 741e00ab-843f-4669-ba88-bc4dfb76ef77 to port bac56807-d1e8-4e80-8e99-25b19600d119 May 27 03:29:36.108341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:36.109074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:36.116127 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.116606 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.117538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.118159 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.324680 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.334663 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.336380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.337783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c5e3eaf8-7327-48ff-8c4f-c424d676e41c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1742 microversion: 2.20 time: 0.233744 May 27 03:29:36.338786 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 434/905] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:36 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1742 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:36.411909 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f230f51d-5083-4b26-8ab9-84cc1597700a tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/action" status: 202 len: 0 microversion: 2.1 time: 0.637768 May 27 03:29:36.412526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 472/906] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:29:35 2022] POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:29:36.433894 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:36.445234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:36.451529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.451958 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.452836 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.453318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.619779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-7c2a9187-ecdd-4912-966b-2cd146c0ad92 req-1ed35659-2c84-4d4b-8337-ce96b8972564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70020c76-0cc4-4adf-985d-4bd2c1b6b0da", "tag": "bac56807-d1e8-4e80-8e99-25b19600d119"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:36.630630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7c2a9187-ecdd-4912-966b-2cd146c0ad92 req-1ed35659-2c84-4d4b-8337-ce96b8972564 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.632393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7c2a9187-ecdd-4912-966b-2cd146c0ad92 req-1ed35659-2c84-4d4b-8337-ce96b8972564 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.650302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-7c2a9187-ecdd-4912-966b-2cd146c0ad92 req-1ed35659-2c84-4d4b-8337-ce96b8972564 service nova] Creating event network-changed:bac56807-d1e8-4e80-8e99-25b19600d119 for instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da on hv-cinder-82880 May 27 03:29:36.656215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-7c2a9187-ecdd-4912-966b-2cd146c0ad92 req-1ed35659-2c84-4d4b-8337-ce96b8972564 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043090 May 27 03:29:36.656828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 473/907] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:29:36.663312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.672391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-63ed282d-06c0-4d99-abeb-69397c060a39 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1759 microversion: 2.1 time: 0.252844 May 27 03:29:36.672999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 435/908] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:36 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1759 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:29:36.833086 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:36.833834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:36.840635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.841117 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.841879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:36.842342 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:36.980707 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:36.990606 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b11ca9cb-d38c-419f-8a8f-fe8ec2ec37dd tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1555 microversion: 2.1 time: 0.161731 May 27 03:29:36.991395 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 474/909] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:29:36 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:29:37.008187 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cd6af168-bbd2-4169-9737-649af3d2d2d1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:37.008656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cd6af168-bbd2-4169-9737-649af3d2d2d1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:37.019494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd6af168-bbd2-4169-9737-649af3d2d2d1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:37.020097 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd6af168-bbd2-4169-9737-649af3d2d2d1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:37.021381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd6af168-bbd2-4169-9737-649af3d2d2d1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:37.021827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd6af168-bbd2-4169-9737-649af3d2d2d1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:37.106126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cd6af168-bbd2-4169-9737-649af3d2d2d1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102196 May 27 03:29:37.107107 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 436/910] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 03:29:37 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:37.356788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:37.357783 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:37.364082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:37.366836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:37.367295 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:37.368491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:37.369662 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:37.624420 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:37.625232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:37.626909 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:37.628074 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cf2c7c9d-b43d-4869-a612-f6f95e0c3b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1742 microversion: 2.20 time: 0.275577 May 27 03:29:37.628629 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 475/911] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:37 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1742 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:38.647287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:38.648135 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:38.654590 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:38.655013 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:38.655927 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:38.656370 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:38.672091 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-dbbbc378-45c9-4491-bf3b-1e883bbc3375 req-982d1751-1ad3-486f-a25f-be2ccc27c02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0e8bee-579d-4c69-b1cb-516d6216e089", "tag": "72e619f9-cc36-4b46-b89f-a4af82c97aa9"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:38.682359 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dbbbc378-45c9-4491-bf3b-1e883bbc3375 req-982d1751-1ad3-486f-a25f-be2ccc27c02f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:38.682868 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dbbbc378-45c9-4491-bf3b-1e883bbc3375 req-982d1751-1ad3-486f-a25f-be2ccc27c02f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:38.698144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-dbbbc378-45c9-4491-bf3b-1e883bbc3375 req-982d1751-1ad3-486f-a25f-be2ccc27c02f service nova] Creating event network-changed:72e619f9-cc36-4b46-b89f-a4af82c97aa9 for instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 on hv-cinder-82880 May 27 03:29:38.705607 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-dbbbc378-45c9-4491-bf3b-1e883bbc3375 req-982d1751-1ad3-486f-a25f-be2ccc27c02f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037538 May 27 03:29:38.706618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 476/912] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:38.811644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:38.820056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:38.821667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:38.822840 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-011ab690-5263-45fd-9e33-5df65dc0d913 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1742 microversion: 2.20 time: 0.180179 May 27 03:29:38.823405 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 437/913] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:38 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:39.849210 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:39.850410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:39.860378 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:39.860825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:39.861668 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:39.862105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:40.002003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:40.015060 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:40.017558 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:40.019292 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ebf1fe04-14db-424a-bc7e-d1300e75e0dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1742 microversion: 2.20 time: 0.179637 May 27 03:29:40.020069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 477/914] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:39 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:40.861845 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-22b0b08c-b5c1-40b9-8079-5d3b381ff11b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:40.862821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-22b0b08c-b5c1-40b9-8079-5d3b381ff11b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:40.871360 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22b0b08c-b5c1-40b9-8079-5d3b381ff11b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:40.871923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22b0b08c-b5c1-40b9-8079-5d3b381ff11b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:40.872737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22b0b08c-b5c1-40b9-8079-5d3b381ff11b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:40.873209 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22b0b08c-b5c1-40b9-8079-5d3b381ff11b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:40.910210 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-22b0b08c-b5c1-40b9-8079-5d3b381ff11b tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052823 May 27 03:29:40.910773 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 438/915] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:29:40 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:40.927844 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2705ada8-7bbc-4963-8406-c4466e12bfd6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:40.929092 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2705ada8-7bbc-4963-8406-c4466e12bfd6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:40.936598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2705ada8-7bbc-4963-8406-c4466e12bfd6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:40.937552 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2705ada8-7bbc-4963-8406-c4466e12bfd6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:40.939183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2705ada8-7bbc-4963-8406-c4466e12bfd6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:40.939777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2705ada8-7bbc-4963-8406-c4466e12bfd6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:40.978090 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2705ada8-7bbc-4963-8406-c4466e12bfd6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/21243f1a-fab3-4268-8713-e1fa62cc3ef1" status: 200 len: 194 microversion: 2.1 time: 0.060123 May 27 03:29:40.978840 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 478/916] 10.222.0.50 () {58 vars in 1412 bytes} [Fri May 27 03:29:40 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/21243f1a-fab3-4268-8713-e1fa62cc3ef1 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:29:41.041495 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:41.042641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:41.052584 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:41.053171 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:41.054061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:41.054445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:41.788412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:41.796511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-002fa558-6c87-4dc1-a044-1ba5f834cab5 req-118235db-e101-468c-ba4d-f82bb1adb360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1b29c-4aa9-4ece-a9ee-fd84d519970f", "name": "network-vif-plugged", "status": "completed", "tag": "5e76e5be-43aa-4f7f-9313-3304d2fd1b0d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:41.806277 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:41.815582 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-002fa558-6c87-4dc1-a044-1ba5f834cab5 req-118235db-e101-468c-ba4d-f82bb1adb360 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:41.816385 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:41.819705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-002fa558-6c87-4dc1-a044-1ba5f834cab5 req-118235db-e101-468c-ba4d-f82bb1adb360 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:41.820746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-98f2a83c-5498-4e5c-aed8-e730c6ee97d0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.780710 May 27 03:29:41.824860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 439/917] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:41 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:41.838000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-002fa558-6c87-4dc1-a044-1ba5f834cab5 req-118235db-e101-468c-ba4d-f82bb1adb360 service nova] Creating event network-vif-plugged:5e76e5be-43aa-4f7f-9313-3304d2fd1b0d for instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f on hv-cinder-82880 May 27 03:29:41.851464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-002fa558-6c87-4dc1-a044-1ba5f834cab5 req-118235db-e101-468c-ba4d-f82bb1adb360 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061234 May 27 03:29:41.852414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 479/918] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:42.399059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-87e58153-b308-4ca9-8755-2d7173269656 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51069c5c-5a0c-45ef-acee-7c87c68a638a"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:42.400744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-87e58153-b308-4ca9-8755-2d7173269656 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:42.409796 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e58153-b308-4ca9-8755-2d7173269656 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:42.410525 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e58153-b308-4ca9-8755-2d7173269656 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:42.411487 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e58153-b308-4ca9-8755-2d7173269656 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:42.411929 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e58153-b308-4ca9-8755-2d7173269656 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:42.843051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:42.843863 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:42.850464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:42.851125 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:42.852120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:42.852556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:43.001773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:43.011111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:43.013220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:43.018103 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-05a1aa6d-482a-472b-887a-75647fe95139 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.181427 May 27 03:29:43.027572 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 480/919] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:42 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:44.039152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:44.040711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:44.051383 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:44.052074 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:44.053459 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:44.054143 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:44.205586 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:44.214942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:44.216792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:44.218072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-495ad956-c014-44fe-9083-5bc54dc9d68c tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.183171 May 27 03:29:44.221007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 481/920] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:44 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:29:45.125202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-87e58153-b308-4ca9-8755-2d7173269656 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "POST /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.729297 May 27 03:29:45.139354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 440/921] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:29:42 2022] POST /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments => generated 194 bytes in 2745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:45.239535 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:45.241604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:45.251720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:45.252431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:45.254249 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:45.254829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:45.424819 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:45.434091 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:45.436072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:45.437504 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bd43d20b-5124-4d3d-999d-68357f9f1846 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.203693 May 27 03:29:45.438385 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 482/922] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:45 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:46.456805 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:46.457720 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:46.465263 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:46.466047 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:46.466888 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:46.467540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:46.636652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:46.648386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:46.650454 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:46.652027 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bb35a632-9bda-46bd-a356-e2872095a6d2 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.199665 May 27 03:29:46.666084 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 441/923] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:46 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:47.672908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:47.673699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:47.686912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:47.689327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:47.691517 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:47.691971 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:47.843431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:47.852155 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:47.853702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:47.854876 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e05228b2-845e-48bf-8069-a30dcadbbbdc tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.187206 May 27 03:29:47.855969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 483/924] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:47 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:48.874805 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:48.875411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:48.882586 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:48.883323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:48.884481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:48.884979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:49.023988 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:49.033449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:49.035524 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:49.036935 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6cee3911-c1b8-4295-b3b3-37f16aee16b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.166592 May 27 03:29:49.037514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 442/925] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:48 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:50.055246 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:50.056015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:50.064120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:50.064569 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:50.065386 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:50.065807 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:50.216017 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:50.224579 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:50.226137 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:50.227315 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eac66f62-faa8-4b8f-a844-dd789b7a6e13 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.176275 May 27 03:29:50.228082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 484/926] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:50 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:51.250141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:51.251135 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:51.263914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:51.264652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:51.265963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:51.266681 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:51.403231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:51.415229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:51.417622 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:51.419455 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c80f1fe1-fa36-4a72-9274-bcdcc59ad145 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1737 microversion: 2.20 time: 0.175827 May 27 03:29:51.420269 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 443/927] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:51 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:52.443615 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:52.444375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:52.452825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:52.453432 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:52.454380 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:52.454921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:52.610449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:52.619118 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:52.620612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:52.621845 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4ac9b98c-9b49-4a6a-9205-5539a11469df tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1719 microversion: 2.20 time: 0.184800 May 27 03:29:52.622453 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 485/928] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:52 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:53.643512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:53.644171 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:53.651262 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.651705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.652470 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.652908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.787952 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:53.796282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:53.797823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:53.799114 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1b1a79cd-9525-4575-b8df-864f2acf9b8e tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1719 microversion: 2.20 time: 0.160584 May 27 03:29:53.799604 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 444/929] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:53 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:53.855488 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f4afaf27-cfc2-4f7d-99cb-d9a33485d667 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:53.856409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f4afaf27-cfc2-4f7d-99cb-d9a33485d667 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:53.863457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4afaf27-cfc2-4f7d-99cb-d9a33485d667 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.863905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4afaf27-cfc2-4f7d-99cb-d9a33485d667 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.864667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4afaf27-cfc2-4f7d-99cb-d9a33485d667 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:53.865131 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f4afaf27-cfc2-4f7d-99cb-d9a33485d667 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:53.896188 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f4afaf27-cfc2-4f7d-99cb-d9a33485d667 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044504 May 27 03:29:53.896661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 486/930] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:29:53 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:54.040783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-99b54a70-43f8-4d2d-9317-cce58c131dc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:54.041317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-99b54a70-43f8-4d2d-9317-cce58c131dc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:54.047913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99b54a70-43f8-4d2d-9317-cce58c131dc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.048365 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99b54a70-43f8-4d2d-9317-cce58c131dc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.049343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99b54a70-43f8-4d2d-9317-cce58c131dc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.050229 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99b54a70-43f8-4d2d-9317-cce58c131dc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.084823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-99b54a70-43f8-4d2d-9317-cce58c131dc4 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/21243f1a-fab3-4268-8713-e1fa62cc3ef1" status: 200 len: 194 microversion: 2.1 time: 0.048015 May 27 03:29:54.085470 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 445/931] 10.222.0.50 () {58 vars in 1412 bytes} [Fri May 27 03:29:54 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/21243f1a-fab3-4268-8713-e1fa62cc3ef1 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:54.097664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:54.098159 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:54.104498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.104945 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.105731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.106169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.195659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:54.201482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lazy-loading 'services' on Instance uuid a630735e-10a7-46fd-912c-a1792d18fd15 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:54.278664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-337c3af4-bc7b-4da1-bb59-34edb932bb6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/21243f1a-fab3-4268-8713-e1fa62cc3ef1" status: 202 len: 0 microversion: 2.1 time: 0.185337 May 27 03:29:54.279579 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 487/932] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:29:54 2022] DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/21243f1a-fab3-4268-8713-e1fa62cc3ef1 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:29:54.822673 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:54.823583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:54.833411 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.833868 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.834643 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:54.835084 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:54.984907 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:54.994301 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:54.995798 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:54.996991 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-50638d7d-2836-4c33-b707-a4df8fbe0243 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1719 microversion: 2.20 time: 0.181242 May 27 03:29:54.997925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 446/933] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:54 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:56.022034 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:56.023567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:56.034665 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:56.035127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:56.035887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:56.036317 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:56.179426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:56.191437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:56.192985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:56.194150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-efcd9f7e-7680-4fcd-9255-116de02ad202 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1719 microversion: 2.20 time: 0.180623 May 27 03:29:56.194716 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 488/934] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:56 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:56.571046 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-57eda29b-30ed-4387-a61a-fcca8550a409 req-5d20167e-7b8b-4931-b1f3-c7339a2de994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1b29c-4aa9-4ece-a9ee-fd84d519970f", "name": "network-vif-unplugged", "status": "completed", "tag": "5e76e5be-43aa-4f7f-9313-3304d2fd1b0d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:56.575216 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=52 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:56.582141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-57eda29b-30ed-4387-a61a-fcca8550a409 req-5d20167e-7b8b-4931-b1f3-c7339a2de994 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:56.582591 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-57eda29b-30ed-4387-a61a-fcca8550a409 req-5d20167e-7b8b-4931-b1f3-c7339a2de994 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:56.586862 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:56.595298 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-57eda29b-30ed-4387-a61a-fcca8550a409 req-5d20167e-7b8b-4931-b1f3-c7339a2de994 service nova] Creating event network-vif-unplugged:5e76e5be-43aa-4f7f-9313-3304d2fd1b0d for instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f on hv-cinder-82880 May 27 03:29:56.601582 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-57eda29b-30ed-4387-a61a-fcca8550a409 req-5d20167e-7b8b-4931-b1f3-c7339a2de994 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034200 May 27 03:29:56.602191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 447/935] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:29:57.213391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:57.214059 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:57.222563 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.223048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.223904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.224447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.367627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:57.377631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:57.379254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:57.380423 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f5088b48-25ea-4fe4-ae70-9de482b22ac8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1722 microversion: 2.20 time: 0.171586 May 27 03:29:57.380979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 489/936] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:57 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:57.399527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-320ba47f-76cc-4af6-8c0f-47362da8dc67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e73c9ef-fac4-4d9a-8e15-550221bdf3b6"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:57.400775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-320ba47f-76cc-4af6-8c0f-47362da8dc67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:57.408252 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-320ba47f-76cc-4af6-8c0f-47362da8dc67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.408707 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-320ba47f-76cc-4af6-8c0f-47362da8dc67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.409810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-320ba47f-76cc-4af6-8c0f-47362da8dc67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.411270 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-320ba47f-76cc-4af6-8c0f-47362da8dc67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.711144 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-320ba47f-76cc-4af6-8c0f-47362da8dc67 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316264 May 27 03:29:57.711826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 448/937] 10.222.0.50 () {62 vars in 1363 bytes} [Fri May 27 03:29:57 2022] POST /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-volume_attachments => generated 188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:29:57.831001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a88628e9-6b62-4b0f-aec4-c4d16ebc6a47 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:57.831515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a88628e9-6b62-4b0f-aec4-c4d16ebc6a47 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:57.838664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a88628e9-6b62-4b0f-aec4-c4d16ebc6a47 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.839111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a88628e9-6b62-4b0f-aec4-c4d16ebc6a47 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:57.839872 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a88628e9-6b62-4b0f-aec4-c4d16ebc6a47 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:57.840301 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a88628e9-6b62-4b0f-aec4-c4d16ebc6a47 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.149635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a88628e9-6b62-4b0f-aec4-c4d16ebc6a47 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-volume_attachments/2e73c9ef-fac4-4d9a-8e15-550221bdf3b6" status: 202 len: 0 microversion: 2.20 time: 0.322392 May 27 03:29:58.150252 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 490/938] 10.222.0.50 () {60 vars in 1456 bytes} [Fri May 27 03:29:57 2022] DELETE /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-volume_attachments/2e73c9ef-fac4-4d9a-8e15-550221bdf3b6 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:58.206388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cd13cda0-ace3-4745-9deb-97c1885ac6b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:29:58.206981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cd13cda0-ace3-4745-9deb-97c1885ac6b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:58.213283 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd13cda0-ace3-4745-9deb-97c1885ac6b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.213730 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd13cda0-ace3-4745-9deb-97c1885ac6b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.214521 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd13cda0-ace3-4745-9deb-97c1885ac6b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.214949 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd13cda0-ace3-4745-9deb-97c1885ac6b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.311972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cd13cda0-ace3-4745-9deb-97c1885ac6b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "POST /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/action" status: 202 len: 0 microversion: 2.20 time: 0.109562 May 27 03:29:58.312821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 449/939] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 03:29:58 2022] POST /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:29:58.323279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:58.323868 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:58.333584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.334072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.334835 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.335372 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.475486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:58.484163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:58.486965 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:58.488288 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ea84939e-5fc8-4384-807b-ec5cb900c6ac tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1670 microversion: 2.20 time: 0.170031 May 27 03:29:58.488848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 491/940] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:58 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:29:58.583151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4fb98b2c-7a62-42bf-bbb1-1d286b00dc69 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:58.583652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4fb98b2c-7a62-42bf-bbb1-1d286b00dc69 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:58.591318 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fb98b2c-7a62-42bf-bbb1-1d286b00dc69 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.591771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fb98b2c-7a62-42bf-bbb1-1d286b00dc69 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.592553 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fb98b2c-7a62-42bf-bbb1-1d286b00dc69 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.593008 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fb98b2c-7a62-42bf-bbb1-1d286b00dc69 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.635057 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4fb98b2c-7a62-42bf-bbb1-1d286b00dc69 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/51069c5c-5a0c-45ef-acee-7c87c68a638a" status: 200 len: 194 microversion: 2.1 time: 0.056762 May 27 03:29:58.635875 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 450/941] 10.222.0.50 () {58 vars in 1412 bytes} [Fri May 27 03:29:58 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/51069c5c-5a0c-45ef-acee-7c87c68a638a => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:29:58.647519 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:58.648047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:58.654780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.655227 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.656205 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:58.656633 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:58.762318 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lazy-loading 'services' on Instance uuid a630735e-10a7-46fd-912c-a1792d18fd15 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:29:58.846920 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c5aca0ae-5bd5-4e1e-9823-0ce4097a018a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/51069c5c-5a0c-45ef-acee-7c87c68a638a" status: 202 len: 0 microversion: 2.1 time: 0.204709 May 27 03:29:58.853202 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 492/942] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:29:58 2022] DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments/51069c5c-5a0c-45ef-acee-7c87c68a638a => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:29:59.511572 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:29:59.512320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:29:59.521572 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:59.522025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:59.522795 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:29:59.523234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:29:59.663081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:59.672897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:59.674388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:29:59.675979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bc273427-3b97-4dc8-bc5d-e830a4a44282 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1670 microversion: 2.20 time: 0.171234 May 27 03:29:59.677023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 451/943] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:29:59 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:00.698890 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:00.699762 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:00.708281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:00.708843 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:00.709855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:00.710411 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:00.855300 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:00.863731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:00.865436 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:00.866598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c0b08feb-3e22-4bb1-9220-93007f4277ed tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1670 microversion: 2.20 time: 0.173899 May 27 03:30:00.867169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 493/944] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:00 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:01.889852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:01.890864 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:01.902222 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:01.902975 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:01.904251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:01.905022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:02.062284 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:02.074666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:02.075684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:02.076915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dd5c1d79-21bf-494b-9506-d33b58427e1a tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1670 microversion: 2.20 time: 0.193796 May 27 03:30:02.077495 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 452/945] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:01 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:03.095922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.097182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.106352 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.106984 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.107940 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.108522 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.256289 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2056c2c-2557-4a9e-a435-2db13a7ba69d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.258354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c2056c2c-2557-4a9e-a435-2db13a7ba69d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.265489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2056c2c-2557-4a9e-a435-2db13a7ba69d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.265926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2056c2c-2557-4a9e-a435-2db13a7ba69d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.267102 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2056c2c-2557-4a9e-a435-2db13a7ba69d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.267563 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2056c2c-2557-4a9e-a435-2db13a7ba69d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.269502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.280342 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.281889 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.283060 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-270114cb-e43a-4e34-95b6-6d5a998eab2b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.191221 May 27 03:30:03.283604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 494/946] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:03.297668 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c2056c2c-2557-4a9e-a435-2db13a7ba69d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045415 May 27 03:30:03.298566 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 453/947] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:30:03.410358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6a3bc79a-8224-4a13-94f8-5b6abbd59c37 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.411588 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6a3bc79a-8224-4a13-94f8-5b6abbd59c37 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.418104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a3bc79a-8224-4a13-94f8-5b6abbd59c37 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.418556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a3bc79a-8224-4a13-94f8-5b6abbd59c37 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.419324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a3bc79a-8224-4a13-94f8-5b6abbd59c37 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.419813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a3bc79a-8224-4a13-94f8-5b6abbd59c37 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.450130 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6a3bc79a-8224-4a13-94f8-5b6abbd59c37 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044033 May 27 03:30:03.450783 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 495/948] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:30:03.510423 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.510967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.517023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.517486 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.518337 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.518775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.543893 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:30:03.636838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9ecdd7c1-3ea5-45ca-8e13-76fb460f965e tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 204 len: 0 microversion: 2.1 time: 0.130479 May 27 03:30:03.638484 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 454/949] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:03 2022] DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:30:03.646163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:03.647336 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:03.653613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.654062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.654821 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:03.655258 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:03.791203 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:03.799010 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-40bfc767-cc11-4025-9bea-ac862b98b9ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.156874 May 27 03:30:03.799584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 496/950] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:03 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:04.303272 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:04.304131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:04.311114 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.311789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.312549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.313001 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.473075 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.481456 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.482939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.484295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9638b49f-1e07-445f-a0c3-f90422eeae0b tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.185889 May 27 03:30:04.484819 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 455/951] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:04 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:04.816430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:04.817056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:04.824037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.824487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.825421 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:04.825899 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:04.981763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:04.989430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fe742655-4142-4ea1-aa2b-3c719e659f6c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.177254 May 27 03:30:04.989997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 497/952] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:04 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:05.505925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:05.506737 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:05.516742 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.517529 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.518608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:05.519233 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:05.657899 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.667644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.669294 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:05.670470 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-62e73009-80d9-4b45-a0cc-11383d63ada3 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.169029 May 27 03:30:05.671032 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 456/953] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:05 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:06.014488 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:06.016135 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:06.031261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:06.032011 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:06.033047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:06.033681 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:06.203794 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:06.215197 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b6e48fe0-ed8c-425a-9e74-d619df01b4d5 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.206603 May 27 03:30:06.217574 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 498/954] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:06 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:06.689200 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:06.689831 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:06.697070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:06.697506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:06.698334 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:06.698765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:06.835660 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:06.843757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:06.845279 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:06.847034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b5692b0f-c607-41f6-82c6-8db98b68e2dd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.161909 May 27 03:30:06.847586 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 457/955] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:06 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:07.241571 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:07.242900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:07.249884 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:07.251106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:07.252134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:07.252720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:07.446152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:07.455441 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4c6d35cd-a526-4e7a-bc41-e9b405732612 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.222041 May 27 03:30:07.456738 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 499/956] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:07 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:07.866839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:07.867517 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:07.884910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:07.885414 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:07.886628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:07.887334 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:08.073764 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.083602 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.085772 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.087202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-feb143e7-e75a-48a6-b119-e6f05c0867b4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.225082 May 27 03:30:08.088328 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 458/957] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:07 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:08.486886 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:08.487715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:08.494721 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=50 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:08.497102 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:08.509495 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:08.510545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:08.511060 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:08.532910 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:08.721452 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:08.729810 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bfecbd35-ce79-4e1c-bf68-a630360fcf36 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.251698 May 27 03:30:08.730384 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 500/958] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:08 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:09.106586 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:09.107523 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:09.115199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.115866 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.117652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.118480 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.123720 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:09.288030 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.297252 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.299324 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.301778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-505dcda5-adcc-4ce2-b06f-3a5cea1231fd tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.199154 May 27 03:30:09.313901 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 459/959] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:09 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:09.748188 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:09.749508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:09.759043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.759498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.760287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:09.760730 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:09.924080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:09.933773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-60df6c90-926b-4835-a34b-062ff9645605 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.189343 May 27 03:30:09.934358 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 501/960] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:09 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:10.279922 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-6bc8b919-6051-4985-b7dc-c5b61a985161 req-92d1ade3-d72a-4565-98ed-f3412f745733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a630735e-10a7-46fd-912c-a1792d18fd15", "name": "network-vif-unplugged", "status": "completed", "tag": "d6a48426-132d-46f7-b088-8df0294adfe1"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:10.295525 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6bc8b919-6051-4985-b7dc-c5b61a985161 req-92d1ade3-d72a-4565-98ed-f3412f745733 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.302374 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6bc8b919-6051-4985-b7dc-c5b61a985161 req-92d1ade3-d72a-4565-98ed-f3412f745733 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.321254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:10.322050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:10.323074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-6bc8b919-6051-4985-b7dc-c5b61a985161 req-92d1ade3-d72a-4565-98ed-f3412f745733 service nova] Creating event network-vif-unplugged:d6a48426-132d-46f7-b088-8df0294adfe1 for instance a630735e-10a7-46fd-912c-a1792d18fd15 on hv-cinder-82880 May 27 03:30:10.329534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-6bc8b919-6051-4985-b7dc-c5b61a985161 req-92d1ade3-d72a-4565-98ed-f3412f745733 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057882 May 27 03:30:10.336271 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.338703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 460/961] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:10.342925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.343891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.344456 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.516472 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:10.525661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:10.527490 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:10.528849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0ab1ac0e-b954-46a5-ba7a-f4e1dc2be420 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.213016 May 27 03:30:10.529957 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 502/962] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:10 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:10.951761 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:10.952519 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:10.959650 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.960361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:10.961201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:10.961832 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:11.126992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.136542 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b4f5930c-def1-49ff-a2bb-4ee9cfea872c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.188785 May 27 03:30:11.146745 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 461/963] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:10 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:11.548803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:11.549549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:11.567177 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:11.567777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:11.568636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:11.569185 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:11.745794 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.754613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.757072 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:11.758862 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e344c657-05bc-4767-8281-b3ffb69821e9 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.214804 May 27 03:30:11.760206 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 503/964] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:11 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:12.155105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:12.155861 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:12.176699 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.177187 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.178004 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.178566 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.350824 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:12.359111 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-eb5b84f4-ec4a-4315-9bcc-f377a19ccd50 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.208023 May 27 03:30:12.360379 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 462/965] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:12 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:12.778164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:12.779055 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:12.785407 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.786123 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.786900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:12.787314 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:12.982910 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:12.995321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:12.997205 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:13.002713 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7ef99e98-ecfa-4eb0-a588-5122af38f76d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.228406 May 27 03:30:13.003316 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 504/966] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:12 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:13.378504 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:13.379935 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:13.400651 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:13.402231 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:13.403099 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:13.403591 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:13.666848 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:13.676823 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3c4fe38b-3747-4902-9b4d-a44414e8f69c tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.303294 May 27 03:30:13.680273 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 463/967] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:13 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:14.025755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:14.026614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:14.043050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.043502 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.044284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.044723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.248212 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.257492 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.259126 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.260777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-16eaceaf-abca-400a-a1e6-cdc8f9645a09 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.239864 May 27 03:30:14.261534 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 505/968] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:14 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:14.697604 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:14.698351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:14.705457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.705905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.706713 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:14.707146 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:14.846486 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:14.854791 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-22a3b275-4894-4acc-ba69-ad137639bf33 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.161260 May 27 03:30:14.855442 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 464/969] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:14 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:15.282262 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:15.283529 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:15.291917 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.292627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:15.299257 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.299708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:15.440495 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:15.449975 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:15.451548 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:15.452784 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4e44cf4d-41de-44ab-964b-20562e673e44 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.174728 May 27 03:30:15.453447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 506/970] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:15 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:15.874631 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:15.875341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:15.885739 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.886341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:15.887381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:15.887972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:16.100161 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:16.109353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9680632d-1159-41f6-93e8-b7b2a86186ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1670 microversion: 2.1 time: 0.240299 May 27 03:30:16.109923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 465/971] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:15 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1670 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:16.471904 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:16.472486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:16.479379 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:16.479840 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:16.480602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:16.481078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:16.632630 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:16.641933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:16.643698 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:16.645109 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8fb0c02f-c182-488e-ba2c-7a3cd7845842 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.177258 May 27 03:30:16.645850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 507/972] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:16 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:16.831183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-55939d07-673c-42f4-a18e-6292360f2687 req-d6c893bb-43aa-4d1b-810a-50cd5dc19d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a630735e-10a7-46fd-912c-a1792d18fd15", "name": "network-vif-deleted", "tag": "d6a48426-132d-46f7-b088-8df0294adfe1"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:16.842389 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-55939d07-673c-42f4-a18e-6292360f2687 req-d6c893bb-43aa-4d1b-810a-50cd5dc19d24 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:16.842926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-55939d07-673c-42f4-a18e-6292360f2687 req-d6c893bb-43aa-4d1b-810a-50cd5dc19d24 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:16.872482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-55939d07-673c-42f4-a18e-6292360f2687 req-d6c893bb-43aa-4d1b-810a-50cd5dc19d24 service nova] Creating event network-vif-deleted:d6a48426-132d-46f7-b088-8df0294adfe1 for instance a630735e-10a7-46fd-912c-a1792d18fd15 on hv-cinder-82880 May 27 03:30:16.877533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-55939d07-673c-42f4-a18e-6292360f2687 req-d6c893bb-43aa-4d1b-810a-50cd5dc19d24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050668 May 27 03:30:16.882681 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 466/973] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:17.127899 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:17.128511 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:17.135016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:17.135477 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:17.136251 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:17.136689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:17.168521 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:17.169070 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:17.169531 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lazy-loading 'fault' on Instance uuid a630735e-10a7-46fd-912c-a1792d18fd15 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:30:17.214314 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19457c759f0b4f5cbc530364af1f47d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9351d2e0e0e14585820951a9398b35f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.222783 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9a1415d2-32a1-4b72-ba3d-31500d3a0d6d tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 200 len: 1326 microversion: 2.1 time: 0.098681 May 27 03:30:17.223374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 508/974] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:17 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:17.664513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:17.665249 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:17.672121 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:17.672750 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:17.673721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:17.674317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:17.903943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.912799 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.914500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:17.915789 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4ccc154f-186d-4704-927d-7fdd5a4240fb tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.256231 May 27 03:30:17.926494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 467/975] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:17 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:18.240226 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.240925 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:18.248943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.249650 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.250797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.251342 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.265715 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] HTTP exception thrown: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Request method failure captured: May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 HTTP/1.1 May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ26TzgXMf-PIZBOfXf3Ml4boeCdzMCVXiqu2IrGO3Njfnl1PjiaZluW1bdTjnqDxUqBDWxsNC3S5NL3szWirtg_dKPjSK_GTvSGQ-cbT1EOcANsq4hsbih4VU4Ny31WKRhgk4Lvopc-VYRDEkYK8_ucoddxBvT_48niP_C-mvbVBU May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:18.267499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 19457c759f0b4f5cbc530364af1f47d7 May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:18.268928 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'a630735e-10a7-46fd-912c-a1792d18fd15'} May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:18.269751 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:18.270996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:18.272905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Returning 404 to user: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:18.272905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a2f34eee-80cf-4629-8b3b-f8ad0c514594 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 404 len: 111 microversion: 2.1 time: 0.032758 May 27 03:30:18.272905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 509/976] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:18 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:30:18.281014 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b8eaec09-8961-4058-92a4-2fea224057ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '.version_select at 0x7f5e7413a4c0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.297665 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b8eaec09-8961-4058-92a4-2fea224057ca tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-31173070" status: 202 len: 0 microversion: 2.1 time: 0.023222 May 27 03:30:18.300331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 468/977] 10.222.0.50 () {58 vars in 1214 bytes} [Fri May 27 03:30:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-31173070 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:18.934949 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:18.936488 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:18.944475 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.945215 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:18.946298 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:18.946944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.133194 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:19.143830 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:19.145733 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:19.148455 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-11a19af3-f2e3-4c48-ba42-509791de620f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.217519 May 27 03:30:19.149313 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 510/978] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:18 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:19.683367 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d2235117-15d8-4be1-8233-03163704b661 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:19.685001 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d2235117-15d8-4be1-8233-03163704b661 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:19.691914 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2235117-15d8-4be1-8233-03163704b661 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.692457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2235117-15d8-4be1-8233-03163704b661 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.693380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2235117-15d8-4be1-8233-03163704b661 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.694031 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2235117-15d8-4be1-8233-03163704b661 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.772803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d2235117-15d8-4be1-8233-03163704b661 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/action" status: 202 len: 0 microversion: 2.1 time: 0.093510 May 27 03:30:19.773896 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 469/979] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:30:19 2022] POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:19.782064 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:19.782734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:19.793769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.794441 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:19.795380 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:19.795813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.016612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.031987 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fc0b6199-02d3-48c6-9f54-bfee75a77398 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1751 microversion: 2.1 time: 0.253576 May 27 03:30:20.032732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 511/980] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:19 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1751 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:20.168116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:20.168829 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:20.175885 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:20.176572 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.177400 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:20.178184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.441616 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-665c8556-574b-4ffd-80ff-9d21cacafa87 req-e4ea5bab-f1e4-4e77-ad89-b2a792bd7661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1b29c-4aa9-4ece-a9ee-fd84d519970f", "name": "network-vif-plugged", "status": "completed", "tag": "5e76e5be-43aa-4f7f-9313-3304d2fd1b0d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:20.452185 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-665c8556-574b-4ffd-80ff-9d21cacafa87 req-e4ea5bab-f1e4-4e77-ad89-b2a792bd7661 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:20.452864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-665c8556-574b-4ffd-80ff-9d21cacafa87 req-e4ea5bab-f1e4-4e77-ad89-b2a792bd7661 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:20.465049 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.468062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-665c8556-574b-4ffd-80ff-9d21cacafa87 req-e4ea5bab-f1e4-4e77-ad89-b2a792bd7661 service nova] Creating event network-vif-plugged:5e76e5be-43aa-4f7f-9313-3304d2fd1b0d for instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f on hv-cinder-82880 May 27 03:30:20.473553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-665c8556-574b-4ffd-80ff-9d21cacafa87 req-e4ea5bab-f1e4-4e77-ad89-b2a792bd7661 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036285 May 27 03:30:20.475142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 512/981] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:30:20.480109 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.483357 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:20.484805 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1c39fbde-d445-49fd-a6d7-da243aa091b0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.321315 May 27 03:30:20.485496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 470/982] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:20 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:30:21.050580 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.051509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.062048 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.062499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.063277 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.063711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.216937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.225087 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-44ddd7b4-4a70-4642-950f-8ea49fffa306 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1751 microversion: 2.1 time: 0.178773 May 27 03:30:21.225764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 513/983] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:21 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:21.426825 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.427333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.434125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.434576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.435299 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.435748 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.449489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] HTTP exception thrown: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Request method failure captured: May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 HTTP/1.1 May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ26TzgXMf-PIZBOfXf3Ml4boeCdzMCVXiqu2IrGO3Njfnl1PjiaZluW1bdTjnqDxUqBDWxsNC3S5NL3szWirtg_dKPjSK_GTvSGQ-cbT1EOcANsq4hsbih4VU4Ny31WKRhgk4Lvopc-VYRDEkYK8_ucoddxBvT_48niP_C-mvbVBU May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:21.451176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 19457c759f0b4f5cbc530364af1f47d7 May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.452589 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'a630735e-10a7-46fd-912c-a1792d18fd15'} May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:21.453636 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.455018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:21.457508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Returning 404 to user: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:21.457508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d8637155-ea2c-454a-8192-8ac1931ec944 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 404 len: 111 microversion: 2.1 time: 0.029868 May 27 03:30:21.457508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 471/984] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:21 2022] DELETE /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:21.464195 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.464854 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a630735e-10a7-46fd-912c-a1792d18fd15] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.476615 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.477177 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.478015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.478558 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.493828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] HTTP exception thrown: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Request method failure captured: May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 HTTP/1.1 May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ26TzgXMf-PIZBOfXf3Ml4boeCdzMCVXiqu2IrGO3Njfnl1PjiaZluW1bdTjnqDxUqBDWxsNC3S5NL3szWirtg_dKPjSK_GTvSGQ-cbT1EOcANsq4hsbih4VU4Ny31WKRhgk4Lvopc-VYRDEkYK8_ucoddxBvT_48niP_C-mvbVBU May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:21.495542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 19457c759f0b4f5cbc530364af1f47d7 May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.497111 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'a630735e-10a7-46fd-912c-a1792d18fd15'} May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:21.497992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. May 27 03:30:21.499345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:21.500635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Returning 404 to user: Instance a630735e-10a7-46fd-912c-a1792d18fd15 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:21.500635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e9fdddec-9452-4de3-9f3f-4a344cd783f6 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15" status: 404 len: 111 microversion: 2.1 time: 0.039151 May 27 03:30:21.500635 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 514/985] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:21 2022] GET /compute/v2.1/servers/a630735e-10a7-46fd-912c-a1792d18fd15 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:21.510223 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:21.510994 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:21.517807 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.518258 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.519026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:21.519625 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:21.673554 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.692156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.694118 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:21.695519 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-61622958-efc0-41e1-9541-defe1e863db0 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.189921 May 27 03:30:21.696286 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 472/986] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:21 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:22.243448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:22.244121 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:22.250504 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.250957 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.251921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.252353 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.409484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:22.420321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1696bcb0-7ea3-4e40-a65d-42c5a02db3d3 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.180021 May 27 03:30:22.423931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 515/987] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:22 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:22.669537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:22.671088 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:22.679714 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.680547 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.681808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.682458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.704141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] HTTP exception thrown: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Request method failure captured: May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 HTTP/1.1 May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ26TzgXMf-PIZBOfXf3Ml4boeCdzMCVXiqu2IrGO3Njfnl1PjiaZluW1bdTjnqDxUqBDWxsNC3S5NL3szWirtg_dKPjSK_GTvSGQ-cbT1EOcANsq4hsbih4VU4Ny31WKRhgk4Lvopc-VYRDEkYK8_ucoddxBvT_48niP_C-mvbVBU May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:22.705850 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 19457c759f0b4f5cbc530364af1f47d7 May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.707580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'a04444dd-f9dd-428f-b524-fba73fc83fe4'} May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:22.708320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.711377 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.714808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Returning 404 to user: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:22.714808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e852fc21-0906-4915-addb-4d490f30028a tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 404 len: 111 microversion: 2.1 time: 0.044456 May 27 03:30:22.714808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 473/988] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:22 2022] DELETE /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:22.717726 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:22.718504 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:22.722915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:22.723910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] [instance: a04444dd-f9dd-428f-b524-fba73fc83fe4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:22.727014 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.727592 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.728726 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.729321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.731131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.731580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.732592 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:22.733074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:22.749066 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] HTTP exception thrown: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Request method failure captured: May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 HTTP/1.1 May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ26TzgXMf-PIZBOfXf3Ml4boeCdzMCVXiqu2IrGO3Njfnl1PjiaZluW1bdTjnqDxUqBDWxsNC3S5NL3szWirtg_dKPjSK_GTvSGQ-cbT1EOcANsq4hsbih4VU4Ny31WKRhgk4Lvopc-VYRDEkYK8_ucoddxBvT_48niP_C-mvbVBU May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:22.750518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9351d2e0e0e14585820951a9398b35f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 9351d2e0e0e14585820951a9398b35f4 May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1734808862 May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 19457c759f0b4f5cbc530364af1f47d7 May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeTestJSON-1734808862-project May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.752214 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'a04444dd-f9dd-428f-b524-fba73fc83fe4'} May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:22.753005 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. May 27 03:30:22.754372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:22.756308 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] Returning 404 to user: Instance a04444dd-f9dd-428f-b524-fba73fc83fe4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:22.756308 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5e0bc38e-e564-4500-a903-14c4000ddc55 tempest-AttachVolumeTestJSON-1734808862 tempest-AttachVolumeTestJSON-1734808862-project] 10.222.0.50 "GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4" status: 404 len: 111 microversion: 2.1 time: 0.033782 May 27 03:30:22.756308 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 474/989] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:22 2022] GET /compute/v2.1/servers/a04444dd-f9dd-428f-b524-fba73fc83fe4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:22.936757 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:22.946360 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:22.948235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:22.949631 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ae0e338d-de11-45cf-918b-187aaf6d0a45 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1728 microversion: 2.20 time: 0.238306 May 27 03:30:22.950664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 516/990] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:22 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:23.441811 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:23.442415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:23.448568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.449061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.449839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.450282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.700237 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:23.709236 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-64c9dfde-4903-449f-8e22-c152d9aee3f5 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.270984 May 27 03:30:23.709944 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 475/991] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:23 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:23.968278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:23.968884 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:23.980017 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.980710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:23.981768 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:23.982398 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.181870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.201539 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.210503 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.212725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2ea4c584-b29e-40d9-9c79-b333c64ab21f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1715 microversion: 2.20 time: 0.248598 May 27 03:30:24.213710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 517/992] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:30:23 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1715 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:30:24.728263 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:24.729569 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:24.737295 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:24.738017 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.738988 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:24.739432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:24.977951 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:24.986503 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-de8d3de9-0827-4c10-89a5-44616fc1f926 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.262769 May 27 03:30:24.987303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 476/993] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:24 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:25.483961 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86e70885-1de2-4c7c-bcdf-70c06c9b9737 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:25.485268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-86e70885-1de2-4c7c-bcdf-70c06c9b9737 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:25.496220 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86e70885-1de2-4c7c-bcdf-70c06c9b9737 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.496877 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86e70885-1de2-4c7c-bcdf-70c06c9b9737 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.497739 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86e70885-1de2-4c7c-bcdf-70c06c9b9737 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:25.498251 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86e70885-1de2-4c7c-bcdf-70c06c9b9737 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:25.525668 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-86e70885-1de2-4c7c-bcdf-70c06c9b9737 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/ips" status: 200 len: 150 microversion: 2.1 time: 0.045523 May 27 03:30:25.526814 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 518/994] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:30:25 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:26.009482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:26.010927 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:26.019630 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.020826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.022842 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.023457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.377757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:26.388153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f488a3ed-d058-4cc5-9d0f-df5a03215987 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.386936 May 27 03:30:26.395874 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 477/995] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:25 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:26.985365 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6dcdc07e-fb31-459c-b282-06d052880d44 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "016c587d-6c00-4bf6-b3cd-ff89f24e0245"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:26.986693 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6dcdc07e-fb31-459c-b282-06d052880d44 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:26.995568 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6dcdc07e-fb31-459c-b282-06d052880d44 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.996127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6dcdc07e-fb31-459c-b282-06d052880d44 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:26.997097 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6dcdc07e-fb31-459c-b282-06d052880d44 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:26.997598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6dcdc07e-fb31-459c-b282-06d052880d44 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.002895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:27.304557 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6dcdc07e-fb31-459c-b282-06d052880d44 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "POST /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322707 May 27 03:30:27.305940 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 519/996] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 03:30:26 2022] POST /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:27.411056 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:27.412615 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:27.417213 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:27.424008 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.424454 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.425910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:27.426350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:27.616609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:27.625088 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d3fa580b-8a6a-49dc-845b-3229bc7a3565 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.223170 May 27 03:30:27.625652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 478/997] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:27 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:28.428811 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c34fec87-39e0-480c-a974-48bc4d2ca4e5 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Action: 'create', calling method: .version_select at 0x7f5e7429e280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2071120161", "metadata": {"Type": "work"}}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c34fec87-39e0-480c-a974-48bc4d2ca4e5 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Request method failure captured: May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 122 May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEXUU9A9umhuzU0PRfTR-uiJbD1uNlagZZfAxqoXabDaCR7Me6vaVVeSmzXF85BqREJMwzObO3KkGCkZBBZ9LYbQ-OrwM4GTv7aYGWnQkj6edl8YjQAQx9nemp-N9UuehI2NQXZO95sfHtNQqVxyQiRhGAoiadPKjQcauTSF-T9a77w May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:28.444881 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81f6783e23914aedb665d3f39c769f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 48b23be264b746eb9d629c3d403b34dd May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2071120161", "metadata": {"Type": "work"}}} May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: May 27 03:30:28.446516 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2071120161', 'metadata': {'Type': 'work'}}}} May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise error May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi '#$%' May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:28.447670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:30:28.450224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:30:28.451602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 03:30:28.451602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.451602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c34fec87-39e0-480c-a974-48bc4d2ca4e5 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:28.451602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c34fec87-39e0-480c-a974-48bc4d2ca4e5 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.262432 May 27 03:30:28.461952 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 520/998] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 03:30:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:30:28.467398 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8da6c51c-1d35-42ae-9ed1-c4f29f011309 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Action: 'create', calling method: .version_select at 0x7f5e74183700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-796095276", "metadata": {"Type": "work"}}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8da6c51c-1d35-42ae-9ed1-c4f29f011309 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Request method failure captured: May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 119 May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEXUU9A9umhuzU0PRfTR-uiJbD1uNlagZZfAxqoXabDaCR7Me6vaVVeSmzXF85BqREJMwzObO3KkGCkZBBZ9LYbQ-OrwM4GTv7aYGWnQkj6edl8YjQAQx9nemp-N9UuehI2NQXZO95sfHtNQqVxyQiRhGAoiadPKjQcauTSF-T9a77w May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:28.471154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81f6783e23914aedb665d3f39c769f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 48b23be264b746eb9d629c3d403b34dd May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-796095276", "metadata": {"Type": "work"}}} May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: May 27 03:30:28.473687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-796095276', 'metadata': {'Type': 'work'}}}} May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise error May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi '0' May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:28.474704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:30:28.475992 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:30:28.477133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 03:30:28.477133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.477133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8da6c51c-1d35-42ae-9ed1-c4f29f011309 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:28.477133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8da6c51c-1d35-42ae-9ed1-c4f29f011309 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009779 May 27 03:30:28.477133 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 479/999] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 03:30:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:30:28.485512 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-964744ed-bc84-4747-b4ea-056bad955fd0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Action: 'create', calling method: .version_select at 0x7f5e74298550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1864675792", "metadata": {"Type": "work"}}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-964744ed-bc84-4747-b4ea-056bad955fd0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Request method failure captured: May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 119 May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEXUU9A9umhuzU0PRfTR-uiJbD1uNlagZZfAxqoXabDaCR7Me6vaVVeSmzXF85BqREJMwzObO3KkGCkZBBZ9LYbQ-OrwM4GTv7aYGWnQkj6edl8YjQAQx9nemp-N9UuehI2NQXZO95sfHtNQqVxyQiRhGAoiadPKjQcauTSF-T9a77w May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:28.487444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81f6783e23914aedb665d3f39c769f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 48b23be264b746eb9d629c3d403b34dd May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1864675792", "metadata": {"Type": "work"}}} May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: May 27 03:30:28.490267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1864675792', 'metadata': {'Type': 'work'}}}} May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise error May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi '' May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:28.491851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 03:30:28.494412 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 03:30:28.496082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 03:30:28.496082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.496082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-964744ed-bc84-4747-b4ea-056bad955fd0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:28.496082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-964744ed-bc84-4747-b4ea-056bad955fd0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010332 May 27 03:30:28.496082 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 521/1000] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 03:30:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:30:28.499175 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-62db3561-1046-43ae-bd6b-d9d569b6c5f6 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Calling method '.version_select at 0x7f5e7418edc0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:28.528803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-62db3561-1046-43ae-bd6b-d9d569b6c5f6 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] HTTP exception thrown: Volume tempest-invalid-1336300787 could not be found. May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-62db3561-1046-43ae-bd6b-d9d569b6c5f6 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Request method failure captured: May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1336300787 HTTP/1.1 May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEXUU9A9umhuzU0PRfTR-uiJbD1uNlagZZfAxqoXabDaCR7Me6vaVVeSmzXF85BqREJMwzObO3KkGCkZBBZ9LYbQ-OrwM4GTv7aYGWnQkj6edl8YjQAQx9nemp-N9UuehI2NQXZO95sfHtNQqVxyQiRhGAoiadPKjQcauTSF-T9a77w May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:28.530808 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81f6783e23914aedb665d3f39c769f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 48b23be264b746eb9d629c3d403b34dd May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Volume tempest-invalid-1336300787 could not be found. May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'tempest-invalid-1336300787'} May 27 03:30:28.532361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1336300787 could not be found. (HTTP 404) (Request-ID: req-7b25a2df-9da9-4979-8a31-6bb17a3e5e09) May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.533312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:30:28.534594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1336300787 could not be found. May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:28.536234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1336300787 could not be found. May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1336300787 could not be found. May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-62db3561-1046-43ae-bd6b-d9d569b6c5f6 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Returning 404 to user: Volume tempest-invalid-1336300787 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-62db3561-1046-43ae-bd6b-d9d569b6c5f6 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1336300787" status: 404 len: 99 microversion: 2.1 time: 0.037399 May 27 03:30:28.537648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 480/1001] 10.222.0.50 () {58 vars in 1217 bytes} [Fri May 27 03:30:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1336300787 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 03:30:28.548121 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9d304833-5a7f-42b4-842c-1c4d147fff6a tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003757 May 27 03:30:28.548612 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 522/1002] 10.222.0.50 () {58 vars in 1139 bytes} [Fri May 27 03:30:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:30:28.557264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c57fba62-29f5-4b57-bee5-9ca9ab5a1d67 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003785 May 27 03:30:28.558100 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 481/1003] 10.222.0.50 () {58 vars in 1136 bytes} [Fri May 27 03:30:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:30:28.566706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-67252952-5608-49f9-a9d7-127a26583a40 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Calling method '.version_select at 0x7f5e742c3d30>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:28.602644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-67252952-5608-49f9-a9d7-127a26583a40 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] HTTP exception thrown: Volume 97bddbfe-1143-44c1-abe9-101d819566f7 could not be found. May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-67252952-5608-49f9-a9d7-127a26583a40 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Request method failure captured: May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/os-volumes/97bddbfe-1143-44c1-abe9-101d819566f7 HTTP/1.1 May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEXUU9A9umhuzU0PRfTR-uiJbD1uNlagZZfAxqoXabDaCR7Me6vaVVeSmzXF85BqREJMwzObO3KkGCkZBBZ9LYbQ-OrwM4GTv7aYGWnQkj6edl8YjQAQx9nemp-N9UuehI2NQXZO95sfHtNQqVxyQiRhGAoiadPKjQcauTSF-T9a77w May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:28.605003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81f6783e23914aedb665d3f39c769f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 48b23be264b746eb9d629c3d403b34dd May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Volume 97bddbfe-1143-44c1-abe9-101d819566f7 could not be found. May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '97bddbfe-1143-44c1-abe9-101d819566f7'} May 27 03:30:28.606620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97bddbfe-1143-44c1-abe9-101d819566f7 could not be found. (HTTP 404) (Request-ID: req-9de66816-1edb-4ed3-84ee-6515cb304056) May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.607491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 03:30:28.608720 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97bddbfe-1143-44c1-abe9-101d819566f7 could not be found. May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 03:30:28.610001 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97bddbfe-1143-44c1-abe9-101d819566f7 could not be found. May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97bddbfe-1143-44c1-abe9-101d819566f7 could not be found. May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-67252952-5608-49f9-a9d7-127a26583a40 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Returning 404 to user: Volume 97bddbfe-1143-44c1-abe9-101d819566f7 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-67252952-5608-49f9-a9d7-127a26583a40 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/97bddbfe-1143-44c1-abe9-101d819566f7" status: 404 len: 109 microversion: 2.1 time: 0.043547 May 27 03:30:28.611390 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 523/1004] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 03:30:28 2022] DELETE /compute/v2.1/os-volumes/97bddbfe-1143-44c1-abe9-101d819566f7 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:28.617897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-47a13e1a-49f0-4e7d-bade-dc58157b58a0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Calling method '.version_select at 0x7f5e74183280>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:28.644824 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:28.645989 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:28.651705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-47a13e1a-49f0-4e7d-bade-dc58157b58a0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] HTTP exception thrown: Volume 2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f could not be found. May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-47a13e1a-49f0-4e7d-bade-dc58157b58a0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Request method failure captured: May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/os-volumes/2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f HTTP/1.1 May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEXUU9A9umhuzU0PRfTR-uiJbD1uNlagZZfAxqoXabDaCR7Me6vaVVeSmzXF85BqREJMwzObO3KkGCkZBBZ9LYbQ-OrwM4GTv7aYGWnQkj6edl8YjQAQx9nemp-N9UuehI2NQXZO95sfHtNQqVxyQiRhGAoiadPKjQcauTSF-T9a77w May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:28.654136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_81f6783e23914aedb665d3f39c769f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/81f6783e23914aedb665d3f39c769f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 81f6783e23914aedb665d3f39c769f21 May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesNegativeTest-962278247 May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 48b23be264b746eb9d629c3d403b34dd May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesNegativeTest-962278247-project May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Volume 2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f could not be found. May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f'} May 27 03:30:28.655718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f could not be found. (HTTP 404) (Request-ID: req-eb8df64b-5ae6-438c-9daa-cf9222960405) May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.657044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 03:30:28.658594 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f could not be found. May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 03:30:28.660040 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f could not be found. May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f could not be found. May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-47a13e1a-49f0-4e7d-bade-dc58157b58a0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] Returning 404 to user: Volume 2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-47a13e1a-49f0-4e7d-bade-dc58157b58a0 tempest-VolumesNegativeTest-962278247 tempest-VolumesNegativeTest-962278247-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f" status: 404 len: 109 microversion: 2.1 time: 0.042147 May 27 03:30:28.661445 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 482/1005] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 03:30:28 2022] GET /compute/v2.1/os-volumes/2fcaaffd-2745-4a3f-bda6-efdf7b7a2d0f => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:28.675446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:28.675446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:28.676306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:28.676896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:28.857527 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:28.866986 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3dba7801-f432-4585-be9e-01f918529d02 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.227352 May 27 03:30:28.867561 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 524/1006] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:28 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:29.885895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:29.886549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:29.893287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:29.893601 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:29.894363 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:29.894790 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:29.900304 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:30.055826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:30.064038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-db2c4d1e-7513-479d-b2f7-31d848dc8e60 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.184009 May 27 03:30:30.064597 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 483/1007] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:29 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:31.081374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:31.082523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:31.089764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:31.090420 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:31.091348 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:31.091979 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:31.373020 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:31.382099 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ae5d2af0-c8d2-4a09-a607-0b76d17f32d4 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.304059 May 27 03:30:31.382766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 525/1008] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:31 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:32.399092 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:32.399799 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:32.406895 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.407345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.408201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:32.408708 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:32.572532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:32.580834 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e59741c1-03d2-43d4-b5b8-100b4def5233 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.185792 May 27 03:30:32.581536 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 484/1009] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:32 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:33.291724 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1678463706", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "networks": [{"uuid": "978fec81-faf1-44e4-9076-53182f28179b"}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:33.343207 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] validate_networks() for [('978fec81-faf1-44e4-9076-53182f28179b', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:30:33.599353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:33.600596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:33.612097 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.612835 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.614463 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.615530 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.766047 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:30:33.766399 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:30:33.766950 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:30:33.767429 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:30:33.767915 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:30:33.779776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.780708 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.782263 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:33.782774 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:33.806716 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Getting quotas for project 9966ab8ffdcf4e828553261c05fbb5a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:30:33.811030 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Getting quotas for user aa92e046c3274a29a8aa8857d7570750 and project 9966ab8ffdcf4e828553261c05fbb5a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:30:33.826771 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:30:33.829291 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:30:33.853204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:33.862076 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-94d60012-9599-4957-a0c5-5d45fe227daf tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.267313 May 27 03:30:33.862775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 485/1010] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:33 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:33.891201 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5f8e1cc6-87a3-474e-b03a-39fc9a3060ec tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603214 May 27 03:30:33.891888 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 526/1011] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:30:33.907186 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bdcf39c1-a480-467a-bb42-83eada4c76e0 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:33.908101 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bdcf39c1-a480-467a-bb42-83eada4c76e0 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:33.973581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bdcf39c1-a480-467a-bb42-83eada4c76e0 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:33.981840 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bdcf39c1-a480-467a-bb42-83eada4c76e0 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1214 microversion: 2.1 time: 0.078668 May 27 03:30:33.982431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 486/1012] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:33 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:34.881023 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:34.882114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:34.889936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:34.890391 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:34.891624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:34.892069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:35.000118 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:35.002456 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:35.024022 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:35.024484 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:35.025356 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:35.028457 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:35.099416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:35.106921 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:35.116303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-30e9f217-9eb7-4f4e-ae77-6fb7f56cabde tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1266 microversion: 2.1 time: 0.120489 May 27 03:30:35.116833 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7189a8f3-39a8-4940-8251-b679e0a4da10 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.240911 May 27 03:30:35.118003 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 527/1013] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:34 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:35.126704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 487/1014] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:34 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:35.136152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:35.136685 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:35.144914 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:35.149256 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:35.150138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:35.150613 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:35.268374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lazy-loading 'services' on Instance uuid 5e0e8bee-579d-4c69-b1cb-516d6216e089 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:30:35.367243 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-285f45ea-6c6d-46bf-8c9f-8d4842714865 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments/016c587d-6c00-4bf6-b3cd-ff89f24e0245" status: 202 len: 0 microversion: 2.1 time: 0.247808 May 27 03:30:35.368061 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 528/1015] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:30:35 2022] DELETE /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments/016c587d-6c00-4bf6-b3cd-ff89f24e0245 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:35.378648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-30c283bd-eb0a-4fe1-81cc-519e20c4ff10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:35.379946 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-30c283bd-eb0a-4fe1-81cc-519e20c4ff10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:35.386532 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30c283bd-eb0a-4fe1-81cc-519e20c4ff10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:35.387182 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30c283bd-eb0a-4fe1-81cc-519e20c4ff10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:35.387998 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30c283bd-eb0a-4fe1-81cc-519e20c4ff10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:35.388611 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30c283bd-eb0a-4fe1-81cc-519e20c4ff10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:35.421767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-30c283bd-eb0a-4fe1-81cc-519e20c4ff10 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047210 May 27 03:30:35.422289 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 488/1016] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:30:35 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:36.137281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:36.138078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:36.138980 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:36.140242 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:36.148270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:36.148854 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:36.149776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:36.150897 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:36.163018 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:36.163493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:36.164302 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:36.165627 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:36.330225 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:36.338115 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5d42a1be-0848-47d1-a1ef-07941b017a84 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.206553 May 27 03:30:36.339119 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 529/1017] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:36 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:36.434420 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3547e779-87a1-4063-aef8-7cfa86f13f96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:36.435531 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3547e779-87a1-4063-aef8-7cfa86f13f96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:36.444069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3547e779-87a1-4063-aef8-7cfa86f13f96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:36.444815 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3547e779-87a1-4063-aef8-7cfa86f13f96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:36.445804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3547e779-87a1-4063-aef8-7cfa86f13f96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:36.446482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3547e779-87a1-4063-aef8-7cfa86f13f96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:36.473308 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:36.483675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3547e779-87a1-4063-aef8-7cfa86f13f96 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053709 May 27 03:30:36.484736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 530/1018] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:30:36 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:30:36.487198 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4305a6e3-ced9-4d8f-a364-ced61529de2d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.353777 May 27 03:30:36.489008 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 489/1019] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:36 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:36.776942 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-2eb630f6-6ac3-4d86-ad98-50e5e1c61914 req-306d27cc-39cb-4ee6-a26b-72c5ab37f19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17432854-e4ff-4fbf-9ce7-778053f3df8f", "tag": "2d5f20a7-1ebf-4050-bc77-dc40113713f4"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:36.787849 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2eb630f6-6ac3-4d86-ad98-50e5e1c61914 req-306d27cc-39cb-4ee6-a26b-72c5ab37f19a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:36.788488 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2eb630f6-6ac3-4d86-ad98-50e5e1c61914 req-306d27cc-39cb-4ee6-a26b-72c5ab37f19a service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:36.813848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-2eb630f6-6ac3-4d86-ad98-50e5e1c61914 req-306d27cc-39cb-4ee6-a26b-72c5ab37f19a service nova] Creating event network-changed:2d5f20a7-1ebf-4050-bc77-dc40113713f4 for instance 17432854-e4ff-4fbf-9ce7-778053f3df8f on hv-cinder-82880 May 27 03:30:36.819679 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-2eb630f6-6ac3-4d86-ad98-50e5e1c61914 req-306d27cc-39cb-4ee6-a26b-72c5ab37f19a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050128 May 27 03:30:36.820129 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 531/1020] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:37.355472 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:37.356082 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:37.362656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.363125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.363985 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.364315 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.499105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ca508b49-0714-4e6c-9bfd-7cb9d8e57dfe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:37.500138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ca508b49-0714-4e6c-9bfd-7cb9d8e57dfe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:37.501024 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:37.508855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca508b49-0714-4e6c-9bfd-7cb9d8e57dfe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.509166 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-45d59d14-8f6d-4eb4-898c-e8a88ea1a62e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.157494 May 27 03:30:37.509307 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca508b49-0714-4e6c-9bfd-7cb9d8e57dfe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.510031 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca508b49-0714-4e6c-9bfd-7cb9d8e57dfe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.510462 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca508b49-0714-4e6c-9bfd-7cb9d8e57dfe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.511706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 490/1021] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:37 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:37.522972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:37.523704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:37.530551 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.530999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.531769 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.532205 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.541800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ca508b49-0714-4e6c-9bfd-7cb9d8e57dfe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047822 May 27 03:30:37.542357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 532/1022] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:30:37 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:30:37.615814 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:37.616352 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:37.625345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.625829 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.626684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.627141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.655944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:30:37.719740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:37.732906 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-880418a8-094d-494e-9a4a-2cbe03b2f480 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1756 microversion: 2.1 time: 0.214405 May 27 03:30:37.733900 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 491/1023] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:37 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:37.754817 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8945b14b-a1ed-44cb-8a4c-93b60d00e25a tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 204 len: 0 microversion: 2.1 time: 0.144277 May 27 03:30:37.755470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 533/1024] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:37 2022] DELETE /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:30:37.764353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:37.765045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:37.774796 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.775236 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.776002 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:37.776432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:37.917124 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:37.925131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e17312b4-48d8-411e-9ea0-a8cc01ae7294 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1680 microversion: 2.1 time: 0.164871 May 27 03:30:37.925704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 492/1025] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:37 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:38.528302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:38.529119 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:38.531710 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:38.538556 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:38.539246 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:38.540159 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:38.540595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:38.709483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:38.718105 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-04b0519e-8245-4b4d-9f89-910a7c1078ab tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.194036 May 27 03:30:38.718743 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 534/1026] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:38 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:38.751012 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:38.752347 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:38.760349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:38.760800 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:38.761695 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:38.762120 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:38.914515 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:38.922987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-57557efd-7e01-4a85-886f-b3af89cbb393 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1759 microversion: 2.1 time: 0.176475 May 27 03:30:38.923567 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 493/1027] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:38 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:38.944464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:38.945107 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:38.951492 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:38.953947 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:38.954779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:38.955172 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:39.092930 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:39.101240 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8d079a46-4618-4dcd-b67a-7e93c86de0e5 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1680 microversion: 2.1 time: 0.162416 May 27 03:30:39.101825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 535/1028] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:38 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:39.735987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:39.736599 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:39.743931 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:39.744384 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:39.745242 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:39.745689 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:39.907149 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:39.916413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-99647f76-6fda-4488-889b-76b9115ca730 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.184346 May 27 03:30:39.918256 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 494/1029] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:39 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:40.120880 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:40.121599 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:40.129750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:40.130804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:40.131914 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:40.132410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:40.290156 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:40.304546 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5b6c0a09-60a5-4b3b-97b3-8111d1920228 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1680 microversion: 2.1 time: 0.187860 May 27 03:30:40.305479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 536/1030] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:40 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:40.933482 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:40.934072 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:40.943467 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:40.945143 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:40.946593 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:40.947270 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:41.214064 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:41.227612 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e8d433d6-8ae1-45d7-b395-957291db412b tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.298020 May 27 03:30:41.228288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 495/1031] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:40 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:41.325275 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:41.325921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:41.338092 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:41.338322 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:41.341169 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:41.342157 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:41.362460 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:41.530779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:41.546208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e639c201-c35f-4bfc-b0de-5b89b4da7e90 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1680 microversion: 2.1 time: 0.227462 May 27 03:30:41.547717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 537/1032] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:41 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:42.143647 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-6f80e85e-8076-4480-b69c-cfbb9acc8c4d req-af248d81-0f1b-4569-84e3-9326bf839a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0e8bee-579d-4c69-b1cb-516d6216e089", "name": "network-vif-deleted", "tag": "72e619f9-cc36-4b46-b89f-a4af82c97aa9"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:42.157480 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6f80e85e-8076-4480-b69c-cfbb9acc8c4d req-af248d81-0f1b-4569-84e3-9326bf839a34 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:42.157852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6f80e85e-8076-4480-b69c-cfbb9acc8c4d req-af248d81-0f1b-4569-84e3-9326bf839a34 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:42.169765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-6f80e85e-8076-4480-b69c-cfbb9acc8c4d req-af248d81-0f1b-4569-84e3-9326bf839a34 service nova] Creating event network-vif-deleted:72e619f9-cc36-4b46-b89f-a4af82c97aa9 for instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 on hv-cinder-82880 May 27 03:30:42.175291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-6f80e85e-8076-4480-b69c-cfbb9acc8c4d req-af248d81-0f1b-4569-84e3-9326bf839a34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035639 May 27 03:30:42.176058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 496/1033] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:42.245259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:42.246371 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:42.253023 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:42.253667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:42.254697 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:42.255455 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:42.420261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:42.429071 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fc088178-6690-4b29-8eea-62575ca9db08 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.187654 May 27 03:30:42.429884 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 538/1034] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:42 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:42.568342 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:42.569262 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:42.578516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:42.578967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:42.579746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:42.580204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:42.675444 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:42.676325 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:42.677629 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lazy-loading 'fault' on Instance uuid 5e0e8bee-579d-4c69-b1cb-516d6216e089 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:30:42.745343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a094273e734342eca2bdf159fab8a8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '082b5523ee504be09f6fcaf833207a4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:42.757104 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2d7d2bf5-cd05-4b33-8273-56f2ec786a59 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 200 len: 1329 microversion: 2.1 time: 0.196311 May 27 03:30:42.763460 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 497/1035] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:42 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 1329 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:43.447526 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:43.448231 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:43.460016 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:43.460744 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:43.461998 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:43.462618 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:43.610681 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:43.620127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-66f16984-cb73-4acb-a0db-54b18a8bcecb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.177536 May 27 03:30:43.620725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 539/1036] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:43 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:43.779143 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:43.779694 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:43.786163 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:43.786810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:43.787581 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:43.788021 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:43.801687 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 HTTP/1.1 May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:43.803531 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:43.804890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '5e0e8bee-579d-4c69-b1cb-516d6216e089'} May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:43.805670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:43.807038 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:43.808475 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:43.808475 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-628e3225-ebe9-4065-9a98-f8ce8f8b3590 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 404 len: 111 microversion: 2.1 time: 0.029895 May 27 03:30:43.808475 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 498/1037] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:43 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:43.817440 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0774add3-f9dc-4e06-9df9-d55f811662a1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '.version_select at 0x7f5e743e4af0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:43.820885 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0774add3-f9dc-4e06-9df9-d55f811662a1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [a73f0304-2958-4aed-8a1c-3b162ca202fa] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:30:43.821268 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:43.821995 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:44.478044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-08b901c1-a77e-44f9-aabc-45204bf0ab0d req-c311bd58-b61d-4199-adfb-0bb1026e548c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17432854-e4ff-4fbf-9ce7-778053f3df8f", "name": "network-vif-plugged", "status": "completed", "tag": "2d5f20a7-1ebf-4050-bc77-dc40113713f4"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:44.481654 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:44.495325 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-08b901c1-a77e-44f9-aabc-45204bf0ab0d req-c311bd58-b61d-4199-adfb-0bb1026e548c service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:44.495797 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-08b901c1-a77e-44f9-aabc-45204bf0ab0d req-c311bd58-b61d-4199-adfb-0bb1026e548c service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:44.510160 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-08b901c1-a77e-44f9-aabc-45204bf0ab0d req-c311bd58-b61d-4199-adfb-0bb1026e548c service nova] Creating event network-vif-plugged:2d5f20a7-1ebf-4050-bc77-dc40113713f4 for instance 17432854-e4ff-4fbf-9ce7-778053f3df8f on hv-cinder-82880 May 27 03:30:44.517141 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-08b901c1-a77e-44f9-aabc-45204bf0ab0d req-c311bd58-b61d-4199-adfb-0bb1026e548c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042212 May 27 03:30:44.518265 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 499/1038] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:30:44.638464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:44.639611 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:44.647074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:44.647811 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:44.648653 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:44.649145 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:44.790110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:44.798043 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cb8a9a8f-37b0-4e28-95cf-c5ebb30670a9 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.164023 May 27 03:30:44.798613 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 500/1039] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:44 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:44.829019 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [None req-0774add3-f9dc-4e06-9df9-d55f811662a1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [a73f0304-2958-4aed-8a1c-3b162ca202fa] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59160. May 27 03:30:44.849702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0774add3-f9dc-4e06-9df9-d55f811662a1 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-186588876" status: 202 len: 0 microversion: 2.1 time: 1.038953 May 27 03:30:44.850582 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 540/1040] 10.222.0.50 () {58 vars in 1217 bytes} [Fri May 27 03:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-186588876 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:30:45.819628 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:45.820571 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:45.831988 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:45.832746 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:45.833826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:45.834262 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:45.968469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:45.976429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-49a345f5-a436-40be-86a4-88b5ee299eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.163599 May 27 03:30:45.976982 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 501/1041] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:45 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:46.994278 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:46.994924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:47.002805 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:47.003254 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:47.004023 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:47.004458 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:47.149792 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:47.158576 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c32b839b-6d1c-4eea-af72-686a15620e63 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.168716 May 27 03:30:47.159141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 541/1042] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:46 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:48.176105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:48.176686 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:48.183840 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.184290 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.185095 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.185537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.203527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:48.320704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:48.328469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-725b2399-1d48-482f-8491-f2bf20b8c6c5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1314 microversion: 2.1 time: 0.156399 May 27 03:30:48.329074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 502/1043] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:48 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:48.735519 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:48.736017 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:48.743860 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.744374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.745172 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.745610 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.760924 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 HTTP/1.1 May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:48.762598 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.764037 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '5e0e8bee-579d-4c69-b1cb-516d6216e089'} May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:48.764820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.766196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:48.767443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:48.767443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-63b0f283-47c9-4508-bf90-74de4f61105e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 404 len: 111 microversion: 2.1 time: 0.033178 May 27 03:30:48.767443 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 542/1044] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:48 2022] DELETE /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:48.772638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:48.773396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 5e0e8bee-579d-4c69-b1cb-516d6216e089] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:48.779429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.779882 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.780650 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:48.781116 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:48.797172 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 HTTP/1.1 May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:48.798810 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.800125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '5e0e8bee-579d-4c69-b1cb-516d6216e089'} May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:48.800930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. May 27 03:30:48.802156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:48.803332 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 5e0e8bee-579d-4c69-b1cb-516d6216e089 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:48.808089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-61c54d6c-5bc2-4231-87e7-60b18fa17395 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089" status: 404 len: 111 microversion: 2.1 time: 0.039237 May 27 03:30:48.808825 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 503/1045] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:48 2022] GET /compute/v2.1/servers/5e0e8bee-579d-4c69-b1cb-516d6216e089 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:49.345943 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:49.346549 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:49.353387 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:49.353901 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:49.354686 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:49.355216 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:49.496118 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:49.504428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b24da560-074d-49e6-b034-ad25ffa71eff tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1499 microversion: 2.1 time: 0.162440 May 27 03:30:49.505013 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 543/1046] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:49 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:49.960105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:49.960638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:49.968350 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:49.968802 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:49.969591 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:49.970025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:49.984697 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 HTTP/1.1 May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:49.986282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:49.988023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '9d25eaff-39bb-4434-848b-7b2dcc68d1e9'} May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:49.988853 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:49.990291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:49.991618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:49.991618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fb3d6223-2f31-4212-9bda-1394563729a2 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 404 len: 111 microversion: 2.1 time: 0.031435 May 27 03:30:49.991618 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 504/1047] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:49 2022] DELETE /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:49.996818 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:49.997454 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 9d25eaff-39bb-4434-848b-7b2dcc68d1e9] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:50.004067 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.004509 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.005304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.005736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.020033 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 HTTP/1.1 May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:50.021590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:50.023190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '9d25eaff-39bb-4434-848b-7b2dcc68d1e9'} May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:50.024028 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. May 27 03:30:50.025287 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.026356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 9d25eaff-39bb-4434-848b-7b2dcc68d1e9 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:50.026356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-49e86297-f124-4a41-91e6-1f592321f73e tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9" status: 404 len: 111 microversion: 2.1 time: 0.030672 May 27 03:30:50.026356 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 544/1048] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:49 2022] GET /compute/v2.1/servers/9d25eaff-39bb-4434-848b-7b2dcc68d1e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:30:50.031832 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:50.032328 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:50.039397 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.039876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.040684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.041151 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.054922 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 HTTP/1.1 May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:30:50.056533 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.058199 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '6e20f854-915e-4f4e-8596-b16df25a2609'} May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:50.059089 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.060535 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:30:50.061967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:50.061967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-91158d66-dd8e-47fa-882d-7c173b997547 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 404 len: 111 microversion: 2.1 time: 0.030086 May 27 03:30:50.061967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 505/1049] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:50 2022] DELETE /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:50.075537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:50.076153 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: 6e20f854-915e-4f4e-8596-b16df25a2609] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:50.082589 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.083041 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.083803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.084238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.104332 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 HTTP/1.1 May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:50.105896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.107232 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '6e20f854-915e-4f4e-8596-b16df25a2609'} May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:50.108066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. May 27 03:30:50.109515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:50.110717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance 6e20f854-915e-4f4e-8596-b16df25a2609 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:50.110717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dcc4de69-47fe-471f-b9ce-a93035e9face tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609" status: 404 len: 111 microversion: 2.1 time: 0.035608 May 27 03:30:50.110717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 545/1050] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:50 2022] GET /compute/v2.1/servers/6e20f854-915e-4f4e-8596-b16df25a2609 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:50.987148 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:50.987717 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:50.994960 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.995408 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:50.996169 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:50.996601 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:51.022308 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:30:51.100418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4da75304-4d8e-446d-be99-5aeddc6a8428 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "DELETE /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 204 len: 0 microversion: 2.1 time: 0.116908 May 27 03:30:51.101263 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 506/1051] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:50 2022] DELETE /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:30:51.109687 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:51.110478 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:51.117255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:51.117700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:51.119150 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:51.119603 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:51.265141 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:51.279800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dd4cb6cd-4213-4d5f-abc8-942efa481366 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1505 microversion: 2.1 time: 0.167477 May 27 03:30:51.279800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 546/1052] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:51 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:30:52.146242 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-317932397", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-940256736", "security_groups": [{"name": "tempest-secgroup-smoke-1104536221"}], "block_device_mapping_v2": [{"uuid": "0ae28e14-0bb5-42de-996c-15ff6c7ed7b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79e2e930-0200-4ceb-a2bb-a93bbb04e0f6"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:52.270136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] validate_networks() for [('79e2e930-0200-4ceb-a2bb-a93bbb04e0f6', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:30:52.291931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:52.292537 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:52.304609 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.304848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.305706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.306183 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.442552 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:52.450569 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-88b1a2a4-6e06-4784-89bc-492724943915 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1505 microversion: 2.1 time: 0.163108 May 27 03:30:52.451403 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 547/1053] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:52 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:52.465245 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:52.465741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:52.471861 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.472276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.473073 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.473510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.489902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 HTTP/1.1 May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:52.491448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.492969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'd00e4700-28c6-4440-83e4-c3d1a86a75c7'} May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:52.493959 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.495174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.496414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:52.496414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-69d73de7-e395-44f8-8642-373f365b2bbe tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 404 len: 111 microversion: 2.1 time: 0.031623 May 27 03:30:52.496414 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 548/1054] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:30:52 2022] DELETE /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:52.502057 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:52.502660 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] [instance: d00e4700-28c6-4440-83e4-c3d1a86a75c7] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:52.509327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.509705 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.510473 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.510902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.524542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] HTTP exception thrown: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Request method failure captured: May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 HTTP/1.1 May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ7QpNQO-9qxvUlZykK1twutNpTuVtOgITdWimxudPz8gpgE9pq8C79aza_jkPUJBH4iF3545LDLoUPSl-GA_pp_9njzeeOD0qozsCgpW7hkMsoEuE2zMAW6utXs4clclW515499qQjpziJyijJF3TbIFaTlA8ASXUCO8AIWXj7Jmo May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:52.526293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/082b5523ee504be09f6fcaf833207a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 082b5523ee504be09f6fcaf833207a4f May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-638824308 May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: a094273e734342eca2bdf159fab8a8d2 May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-638824308-project May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.527883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'd00e4700-28c6-4440-83e4-c3d1a86a75c7'} May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:52.528659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. May 27 03:30:52.529970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:52.531043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] Returning 404 to user: Instance d00e4700-28c6-4440-83e4-c3d1a86a75c7 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:52.531043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3dc27da4-4489-4a90-badf-6519d2e62e76 tempest-AttachVolumeNegativeTest-638824308 tempest-AttachVolumeNegativeTest-638824308-project] 10.222.0.50 "GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7" status: 404 len: 111 microversion: 2.1 time: 0.029216 May 27 03:30:52.531043 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 549/1055] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:52 2022] GET /compute/v2.1/servers/d00e4700-28c6-4440-83e4-c3d1a86a75c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:52.664788 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:30:52.665322 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:30:52.665896 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:30:52.666468 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:30:52.666974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:30:52.675944 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.676396 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.677226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:52.677666 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:52.695839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for project d5bef1b49d424299864523887eb72b3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:30:52.700869 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Getting quotas for user 01be6ea7136e45aead352146193f05ed and project d5bef1b49d424299864523887eb72b3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:30:52.768241 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:30:52.770455 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ae28e14-0bb5-42de-996c-15ff6c7ed7b7',volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:30:52.944044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c97c2e3b-1878-498f-a979-c148838cef0c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.802351 May 27 03:30:52.945156 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 507/1056] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:30:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:30:52.960175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-84a27b12-049f-424e-b140-024cbc986d54 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:52.960175 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-84a27b12-049f-424e-b140-024cbc986d54 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:53.046469 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-84a27b12-049f-424e-b140-024cbc986d54 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:53.066689 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-84a27b12-049f-424e-b140-024cbc986d54 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1093 microversion: 2.1 time: 0.114224 May 27 03:30:53.067266 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 550/1057] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:52 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1093 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:53.469561 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:53.471060 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:53.478986 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:53.479771 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:53.480588 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:53.481287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:53.831549 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:53.839380 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-044a06a4-b72f-406c-bdda-8f29a462f1e5 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1505 microversion: 2.1 time: 0.375359 May 27 03:30:53.839982 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 508/1058] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:53 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:54.084293 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:54.084907 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:54.097976 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.098688 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.099449 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.099948 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.189174 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-eae092fd-e7fb-4972-8d16-7297bd9f212c req-be74164f-bdc0-4090-8ff7-ec9fc2c20816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17432854-e4ff-4fbf-9ce7-778053f3df8f", "name": "network-vif-deleted", "tag": "2d5f20a7-1ebf-4050-bc77-dc40113713f4"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:54.201311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-eae092fd-e7fb-4972-8d16-7297bd9f212c req-be74164f-bdc0-4090-8ff7-ec9fc2c20816 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.204399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-eae092fd-e7fb-4972-8d16-7297bd9f212c req-be74164f-bdc0-4090-8ff7-ec9fc2c20816 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.215129 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:54.228068 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a45c849e-8f4f-40cb-9d97-ebb2f649f59a tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1199 microversion: 2.1 time: 0.144050 May 27 03:30:54.240230 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 551/1059] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:54 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1199 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:54.246890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-eae092fd-e7fb-4972-8d16-7297bd9f212c req-be74164f-bdc0-4090-8ff7-ec9fc2c20816 service nova] Creating event network-vif-deleted:2d5f20a7-1ebf-4050-bc77-dc40113713f4 for instance 17432854-e4ff-4fbf-9ce7-778053f3df8f on hv-cinder-82880 May 27 03:30:54.252940 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-eae092fd-e7fb-4972-8d16-7297bd9f212c req-be74164f-bdc0-4090-8ff7-ec9fc2c20816 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076755 May 27 03:30:54.254117 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 509/1060] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:30:54.859508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:54.860576 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:54.867700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.868208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.870513 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.871463 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.909963 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:54.910586 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:54.911676 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lazy-loading 'fault' on Instance uuid 17432854-e4ff-4fbf-9ce7-778053f3df8f {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:30:54.985887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:54.997025 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c67b93cc-8878-42f2-827b-4ce4da024e88 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 200 len: 1304 microversion: 2.1 time: 0.143765 May 27 03:30:54.997653 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 552/1061] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:54 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:55.247932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:55.248631 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:55.256601 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:55.257073 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:55.257852 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:55.258289 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:55.425428 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:55.472943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-62cac9fa-df50-487e-bbff-a6d4688db91e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1209 microversion: 2.1 time: 0.225224 May 27 03:30:55.473571 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 510/1062] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:55 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:56.020034 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:56.020771 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 17432854-e4ff-4fbf-9ce7-778053f3df8f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:56.035583 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.038034 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.039670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.042595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.095775 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] HTTP exception thrown: Instance 17432854-e4ff-4fbf-9ce7-778053f3df8f could not be found. May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Request method failure captured: May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f HTTP/1.1 May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEXXKRn86wJiKHhPIjEx4FN5tvqkSVR3w8rcxDJujDG-jY1pwxq-JoaXAuRoWAGYnX3I7JAng1Jl6XuZRRWOGk3wHLq-5BcUfas78SwE1zBLw_g8TbowvWwxhsR-vSRcziXMsHwO_YfOdSDkxRwTyykcSSUEtFhZDUSAnGWMR3LfIX8 May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 9966ab8ffdcf4e828553261c05fbb5a9 May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesActionsTest-193416201 May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:30:56.098304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesActionsTest-193416201 May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 9966ab8ffdcf4e828553261c05fbb5a9 May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesActionsTest-193416201 May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesActionsTest-193416201-project May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: aa92e046c3274a29a8aa8857d7570750 May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesActionsTest-193416201-project May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 17432854-e4ff-4fbf-9ce7-778053f3df8f could not be found. May 27 03:30:56.099852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '17432854-e4ff-4fbf-9ce7-778053f3df8f'} May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17432854-e4ff-4fbf-9ce7-778053f3df8f could not be found. May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:30:56.100761 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17432854-e4ff-4fbf-9ce7-778053f3df8f could not be found. May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17432854-e4ff-4fbf-9ce7-778053f3df8f could not be found. May 27 03:30:56.102259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:30:56.118992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Returning 404 to user: Instance 17432854-e4ff-4fbf-9ce7-778053f3df8f could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:30:56.120486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b9be2610-5098-46cb-902f-e6c902e6d174 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f" status: 404 len: 111 microversion: 2.1 time: 0.107120 May 27 03:30:56.122444 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 553/1063] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:56 2022] GET /compute/v2.1/servers/17432854-e4ff-4fbf-9ce7-778053f3df8f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:30:56.352711 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1202449850", "imageRef": "c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6", "flavorRef": "452", "networks": [{"uuid": "978fec81-faf1-44e4-9076-53182f28179b"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:56.419000 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] validate_networks() for [('978fec81-faf1-44e4-9076-53182f28179b', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:30:56.495152 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:56.496146 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:56.503789 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.504496 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.505532 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:56.506522 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:56.684985 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:56.693871 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c8c50d72-452d-40db-bc2d-dbabfa00a4a3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.203415 May 27 03:30:56.694672 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 554/1064] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:56 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:57.326904 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:30:57.329466 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:30:57.330104 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:30:57.330670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:30:57.333407 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:30:57.344428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-a73073c3-7b93-482a-9a73-834145f23c20 req-e87ba431-6846-4044-b8b4-615893f7bbcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5701149d-2291-4cc6-89a6-b5c50fce46c6", "tag": "b50bb324-6116-4314-8d09-3cd6cc80242f"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:30:57.365387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:57.374727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:57.377255 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a73073c3-7b93-482a-9a73-834145f23c20 req-e87ba431-6846-4044-b8b4-615893f7bbcf service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:57.378484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a73073c3-7b93-482a-9a73-834145f23c20 req-e87ba431-6846-4044-b8b4-615893f7bbcf service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:57.383542 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:57.385546 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:57.408506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Getting quotas for project 9966ab8ffdcf4e828553261c05fbb5a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:30:57.413820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-a73073c3-7b93-482a-9a73-834145f23c20 req-e87ba431-6846-4044-b8b4-615893f7bbcf service nova] Creating event network-changed:b50bb324-6116-4314-8d09-3cd6cc80242f for instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 on hv-cinder-82880 May 27 03:30:57.425317 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-a73073c3-7b93-482a-9a73-834145f23c20 req-e87ba431-6846-4044-b8b4-615893f7bbcf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084289 May 27 03:30:57.428346 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 555/1065] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:30:57.446772 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Getting quotas for user aa92e046c3274a29a8aa8857d7570750 and project 9966ab8ffdcf4e828553261c05fbb5a9. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:30:57.464125 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:57.475329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:30:57.482530 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c88171c2-9360-4fa2-9bc6-4e6cfc28e3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:30:57.577297 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-321f5068-da54-4ee2-8b5a-52cbc0bd3f74 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.228579 May 27 03:30:57.577999 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 511/1066] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:30:57.594104 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2d844cbb-e8a3-43c8-bdd4-f9e36316a95c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:57.596265 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2d844cbb-e8a3-43c8-bdd4-f9e36316a95c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:57.711913 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:57.712780 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:57.724044 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:57.724502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:57.725316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:57.725757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:57.741431 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d844cbb-e8a3-43c8-bdd4-f9e36316a95c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:57.750263 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2d844cbb-e8a3-43c8-bdd4-f9e36316a95c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1214 microversion: 2.1 time: 0.164581 May 27 03:30:57.751452 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 556/1067] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:57 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:58.148210 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:58.158995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b786d646-44ec-42e6-9465-f573965c1427 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.451092 May 27 03:30:58.169354 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 512/1068] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:57 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:58.772030 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:58.772717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:58.792759 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:58.793292 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:58.794323 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:58.797852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:58.864345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:58.872865 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0337b638-09dd-4fde-9342-a3c38d810d8f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1266 microversion: 2.1 time: 0.107753 May 27 03:30:58.873797 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 557/1069] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:58 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:59.177568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:59.178724 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:59.191391 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:59.192429 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:59.193458 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:59.193973 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:59.520130 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:59.527925 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2ca426a8-8f02-4142-84d2-0343087942bb tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.355900 May 27 03:30:59.528498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 513/1070] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:59 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:30:59.889682 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:30:59.890915 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:30:59.897281 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:59.898157 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:59.899151 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:30:59.899993 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:30:59.964737 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:30:59.972793 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c1703273-e6e5-4c16-9fdf-269a1dcafebf tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1272 microversion: 2.1 time: 0.086942 May 27 03:30:59.973589 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 558/1071] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:30:59 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:00.545537 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:00.547106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:00.554351 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:00.554956 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:00.555943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:00.556561 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:00.782835 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:00.796869 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-15407446-bf1d-46d2-906a-b19d6bd3cfa9 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.255789 May 27 03:31:00.798386 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 514/1072] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:00 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:00.975241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-73b5b71d-43a6-42dc-814c-361809e7b543 req-af7f467c-f1cd-4bf5-9969-757aecf0c905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a177d80-b71b-4add-9c43-0d8aa96c2775", "tag": "6c4b3a1a-a9f6-4ab6-95ee-23a84f9558f7"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:00.991281 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:00.992161 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:01.006297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-73b5b71d-43a6-42dc-814c-361809e7b543 req-af7f467c-f1cd-4bf5-9969-757aecf0c905 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:01.006918 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:01.007699 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:01.008876 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:01.009558 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-73b5b71d-43a6-42dc-814c-361809e7b543 req-af7f467c-f1cd-4bf5-9969-757aecf0c905 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:01.013630 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:01.023465 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-73b5b71d-43a6-42dc-814c-361809e7b543 req-af7f467c-f1cd-4bf5-9969-757aecf0c905 service nova] Creating event network-changed:6c4b3a1a-a9f6-4ab6-95ee-23a84f9558f7 for instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 on hv-cinder-82880 May 27 03:31:01.029335 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-73b5b71d-43a6-42dc-814c-361809e7b543 req-af7f467c-f1cd-4bf5-9969-757aecf0c905 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059619 May 27 03:31:01.030625 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 559/1073] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:01.242749 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:01.251610 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-43d2c0f8-8d62-46f0-b9ce-637a6b60388a tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1314 microversion: 2.1 time: 0.264070 May 27 03:31:01.252352 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 515/1074] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:00 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:01.815934 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:01.816615 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:01.823366 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:01.823809 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:01.824620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:01.825080 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:01.969289 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:01.977020 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e46c6f4e-5642-4ec4-a16f-fbb7d4bd8062 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.165407 May 27 03:31:01.977644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 560/1075] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:01 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:02.269662 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:02.270726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:02.280685 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:02.281184 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:02.281977 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:02.282418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:02.416043 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:02.428045 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f5d80675-08df-4cb2-b493-4c799cd9b92e tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1314 microversion: 2.1 time: 0.162006 May 27 03:31:02.429208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 516/1076] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:02 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:02.995823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:02.997326 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:03.004894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.005651 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.006781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.007211 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.188069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:03.200905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f0e1789a-c155-4a23-ab2d-7cc7b2d76e06 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.210066 May 27 03:31:03.202291 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 561/1077] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:02 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:03.284491 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-813fb3a0-cb30-4af9-8cf6-f35f833fbb4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:03.285652 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-813fb3a0-cb30-4af9-8cf6-f35f833fbb4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:03.301312 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813fb3a0-cb30-4af9-8cf6-f35f833fbb4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.301986 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813fb3a0-cb30-4af9-8cf6-f35f833fbb4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.302943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813fb3a0-cb30-4af9-8cf6-f35f833fbb4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.303557 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813fb3a0-cb30-4af9-8cf6-f35f833fbb4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.343284 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-813fb3a0-cb30-4af9-8cf6-f35f833fbb4f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062815 May 27 03:31:03.344588 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 517/1078] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 03:31:03 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:31:03.436874 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:03.437691 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:03.446164 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.446552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:03.446971 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:03.447434 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.448244 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.448709 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.454217 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:03.458057 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.458694 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.460576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.461061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.484578 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:31:03.625699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9cffb834-b8fc-4f9a-bad0-1c3249f6b696 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 204 len: 0 microversion: 2.20 time: 0.195363 May 27 03:31:03.626900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 562/1079] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 03:31:03 2022] DELETE /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:31:03.637767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:03.646327 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:03.647269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:03.650513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8814ca07-2e0e-4518-8a18-d70a46765501 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1314 microversion: 2.1 time: 0.208144 May 27 03:31:03.651781 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 518/1080] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:03 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:03.655636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.656189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.657100 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:03.657766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:03.858033 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:03.866345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:03.868170 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:03.869856 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2587f3c5-23e8-4245-8ae7-c86680f8e9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.233986 May 27 03:31:03.870937 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 563/1081] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:31:03 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:31:04.218625 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:04.219953 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:04.226576 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:04.227254 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:04.229037 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:04.229678 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:04.373026 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:04.381521 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fa596615-311c-4069-ae0e-61262bf3703c tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.166787 May 27 03:31:04.382105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 519/1082] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:04 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:04.668324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:04.668975 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:04.675711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:04.676140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:04.676911 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:04.677382 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:04.809616 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:04.817297 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8f52f4a2-05f4-4495-954a-746805f660b3 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1314 microversion: 2.1 time: 0.153148 May 27 03:31:04.817895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 564/1083] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:04 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:04.889735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:04.890344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:04.897359 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:04.897965 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:04.899081 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:04.899932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.049945 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:05.058190 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:05.059828 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:05.061068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e6b278a9-3456-464a-8f54-86b8bdc6b9d6 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.175371 May 27 03:31:05.061641 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 520/1084] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:31:04 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:31:05.399259 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:05.400286 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:05.407602 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.408413 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.409304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.409948 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.550207 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-43bb8881-ab3e-4a5e-9c26-ec1264b4813c req-3f8472da-80a6-40d1-bbf1-c05d6e34de72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a177d80-b71b-4add-9c43-0d8aa96c2775", "name": "network-vif-plugged", "status": "completed", "tag": "6c4b3a1a-a9f6-4ab6-95ee-23a84f9558f7"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:05.573660 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-43bb8881-ab3e-4a5e-9c26-ec1264b4813c req-3f8472da-80a6-40d1-bbf1-c05d6e34de72 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.574106 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-43bb8881-ab3e-4a5e-9c26-ec1264b4813c req-3f8472da-80a6-40d1-bbf1-c05d6e34de72 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.604906 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-43bb8881-ab3e-4a5e-9c26-ec1264b4813c req-3f8472da-80a6-40d1-bbf1-c05d6e34de72 service nova] Creating event network-vif-plugged:6c4b3a1a-a9f6-4ab6-95ee-23a84f9558f7 for instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 on hv-cinder-82880 May 27 03:31:05.608565 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:05.620419 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-43bb8881-ab3e-4a5e-9c26-ec1264b4813c req-3f8472da-80a6-40d1-bbf1-c05d6e34de72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071485 May 27 03:31:05.621120 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-19563db0-331d-4a73-9cbc-c32cf1ef462e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.226125 May 27 03:31:05.621610 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 521/1085] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:31:05.622606 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 565/1086] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:05 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:05.835412 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:05.836426 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:05.842927 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.843378 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.844148 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:05.844590 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:05.862828 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:05.993267 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:06.002446 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e582dfc-f00d-4a6f-b9c6-b7bd3e92ad90 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1314 microversion: 2.1 time: 0.171635 May 27 03:31:06.003034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 522/1087] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:05 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:06.086301 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:06.087285 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:06.096781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.097921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.101123 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.101801 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.281604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:06.290050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:06.292131 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:06.301073 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-26752c03-3fd7-4891-93b6-042eba89af29 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1721 microversion: 2.20 time: 0.221234 May 27 03:31:06.302345 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 566/1088] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:31:06 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:31:06.638611 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:06.640289 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:06.648912 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.649389 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.650358 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:06.651706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:06.910740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:06.920292 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7b0137e4-33d9-4eee-9c8c-18b1ed745a0b tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.285512 May 27 03:31:06.922803 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 523/1089] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:06 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:07.020832 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:07.021486 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:07.028304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.029006 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.029997 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.030807 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.157857 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-af411d78-23b0-44dd-b463-fe3e0f9177be req-8402c63b-cc9c-4a07-b872-84e50218e1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa1b29c-4aa9-4ece-a9ee-fd84d519970f", "name": "network-vif-deleted", "tag": "5e76e5be-43aa-4f7f-9313-3304d2fd1b0d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:07.170348 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-af411d78-23b0-44dd-b463-fe3e0f9177be req-8402c63b-cc9c-4a07-b872-84e50218e1a2 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.171061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-af411d78-23b0-44dd-b463-fe3e0f9177be req-8402c63b-cc9c-4a07-b872-84e50218e1a2 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.232611 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-af411d78-23b0-44dd-b463-fe3e0f9177be req-8402c63b-cc9c-4a07-b872-84e50218e1a2 service nova] Creating event network-vif-deleted:5e76e5be-43aa-4f7f-9313-3304d2fd1b0d for instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f on hv-cinder-82880 May 27 03:31:07.245337 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-af411d78-23b0-44dd-b463-fe3e0f9177be req-8402c63b-cc9c-4a07-b872-84e50218e1a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100800 May 27 03:31:07.251949 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 524/1090] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:07.322540 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:07.323659 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:07.339340 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.339929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:07.340421 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.340811 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.342489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.360181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cdee78ba-e3ca-4a39-8328-91971ea3cb55 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1314 microversion: 2.1 time: 0.343975 May 27 03:31:07.371273 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 567/1091] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:07 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:07.402496 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:07.419388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.420113 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.420726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lazy-loading 'fault' on Instance uuid 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:31:07.460770 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=12 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:07.479719 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:07.489039 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:07.491041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9938d83dc84ae494310741e2cba2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2e4b63d6af43058e0dc76d8ceac844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:07.492543 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-67576106-e56f-4b50-a9b0-bd59e5c1d543 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 200 len: 1370 microversion: 2.20 time: 0.176469 May 27 03:31:07.494055 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 525/1092] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:31:07 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:31:07.649189 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-00a317a3-c12f-4cde-9e46-7dc0b5478e8d req-30f2c604-dc6c-40dd-a96f-d73ecd82c266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5701149d-2291-4cc6-89a6-b5c50fce46c6", "name": "network-vif-plugged", "status": "completed", "tag": "b50bb324-6116-4314-8d09-3cd6cc80242f"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:07.663163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-00a317a3-c12f-4cde-9e46-7dc0b5478e8d req-30f2c604-dc6c-40dd-a96f-d73ecd82c266 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.663822 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-00a317a3-c12f-4cde-9e46-7dc0b5478e8d req-30f2c604-dc6c-40dd-a96f-d73ecd82c266 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.683234 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-00a317a3-c12f-4cde-9e46-7dc0b5478e8d req-30f2c604-dc6c-40dd-a96f-d73ecd82c266 service nova] Creating event network-vif-plugged:b50bb324-6116-4314-8d09-3cd6cc80242f for instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 on hv-cinder-82880 May 27 03:31:07.688518 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-00a317a3-c12f-4cde-9e46-7dc0b5478e8d req-30f2c604-dc6c-40dd-a96f-d73ecd82c266 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044917 May 27 03:31:07.689279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 568/1093] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:07.943740 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:07.944361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:07.969368 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.969847 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:07.970690 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:07.971136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:08.149204 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:08.160432 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c0c6db52-f697-4457-8103-698fa92f2e44 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.224092 May 27 03:31:08.161642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 526/1094] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:07 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:08.383702 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:08.387292 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:08.396375 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:08.413559 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:08.414296 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:08.415828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:08.416329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:08.512230 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:08.513085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:08.524509 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:08.525020 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:08.526110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:08.526545 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:08.554043 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] HTTP exception thrown: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Request method failure captured: May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f HTTP/1.1 May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ5bYeg-FJOD-wolyZgCmo6FaNsAXCY0IzoXQXEmFCMoakMYypeBU7eMvNfiNRl3J80WtRraj9PCDIJaV4n7zflP6uES5vhEscJfW-_LKamKCeKz0D4jP_LpT07GMkGGlYTz8bNwM7ZNzI5RAdRVSnymxRfCGrMxOpKR6XnHbemOOQ May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:31:08.556140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: dd9938d83dc84ae494310741e2cba2ec May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:08.557596 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '3aa1b29c-4aa9-4ece-a9ee-fd84d519970f'} May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:08.558320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:08.559507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:08.561949 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Returning 404 to user: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:08.563016 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c2cae608-f4ef-4df4-8038-d5eb9ad946b8 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 404 len: 111 microversion: 2.20 time: 0.054941 May 27 03:31:08.563794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 527/1095] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:31:08 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 03:31:08.575138 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4eb2420e-437e-4752-8f10-b276ea624fba tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '.version_select at 0x7f5e741f24c0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:08.606933 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:08.615131 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4eb2420e-437e-4752-8f10-b276ea624fba tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422746929" status: 204 len: 0 microversion: 2.20 time: 0.045480 May 27 03:31:08.621561 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 528/1096] 10.222.0.50 () {60 vars in 1261 bytes} [Fri May 27 03:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422746929 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:31:08.626848 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3b5c0769-f616-462e-8036-c6d6e8d80b19 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1498 microversion: 2.1 time: 0.251556 May 27 03:31:08.630069 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 569/1097] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:08 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1498 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:09.179836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:09.179836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:09.182437 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:09.188774 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.189261 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.190155 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.190621 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.371209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:09.385168 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-34c3a04a-5618-4d19-8257-6b5351847e00 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1265 microversion: 2.1 time: 0.210126 May 27 03:31:09.387306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 570/1098] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:09 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:09.428253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:09.429368 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:09.437343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.437894 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.438642 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.439099 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.466186 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:31:09.573039 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a9eb74db-2640-4a86-bf5b-ae074a7d4a58 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 204 len: 0 microversion: 2.1 time: 0.148539 May 27 03:31:09.573815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 529/1099] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:31:09 2022] DELETE /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:31:09.582062 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:09.582678 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:09.589970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.590417 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.591199 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:09.591615 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:09.727489 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:09.735828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-19c634ec-cfb8-4f1a-a2a9-03f61cec03eb tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1504 microversion: 2.1 time: 0.157605 May 27 03:31:09.736595 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 571/1100] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:09 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:10.403498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:10.404201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:10.410303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.410754 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.411545 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.411987 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.529659 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:10.530208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:10.536357 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.536879 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.537734 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.538177 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.552038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] HTTP exception thrown: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Request method failure captured: May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f HTTP/1.1 May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ5bYeg-FJOD-wolyZgCmo6FaNsAXCY0IzoXQXEmFCMoakMYypeBU7eMvNfiNRl3J80WtRraj9PCDIJaV4n7zflP6uES5vhEscJfW-_LKamKCeKz0D4jP_LpT07GMkGGlYTz8bNwM7ZNzI5RAdRVSnymxRfCGrMxOpKR6XnHbemOOQ May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:31:10.553778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: dd9938d83dc84ae494310741e2cba2ec May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.555181 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '3aa1b29c-4aa9-4ece-a9ee-fd84d519970f'} May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:10.555936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.557214 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.558424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Returning 404 to user: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:10.558424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7edbb772-cb38-41e8-9a1b-18f3435ccc2d tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 404 len: 111 microversion: 2.20 time: 0.029538 May 27 03:31:10.558424 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 572/1101] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 03:31:10 2022] DELETE /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:10.564477 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:10.565142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:10.572321 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.572869 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.573773 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.574302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.591531 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] HTTP exception thrown: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Request method failure captured: May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f HTTP/1.1 May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ5bYeg-FJOD-wolyZgCmo6FaNsAXCY0IzoXQXEmFCMoakMYypeBU7eMvNfiNRl3J80WtRraj9PCDIJaV4n7zflP6uES5vhEscJfW-_LKamKCeKz0D4jP_LpT07GMkGGlYTz8bNwM7ZNzI5RAdRVSnymxRfCGrMxOpKR6XnHbemOOQ May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:31:10.594339 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: dd9938d83dc84ae494310741e2cba2ec May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.595973 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '3aa1b29c-4aa9-4ece-a9ee-fd84d519970f'} May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:10.597138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. May 27 03:31:10.598723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:10.600056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Returning 404 to user: Instance 3aa1b29c-4aa9-4ece-a9ee-fd84d519970f could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:10.600056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f550777e-51cd-499c-8bc5-8a2089c4d7a4 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f" status: 404 len: 111 microversion: 2.20 time: 0.037221 May 27 03:31:10.600535 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 573/1102] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:31:10 2022] GET /compute/v2.1/servers/3aa1b29c-4aa9-4ece-a9ee-fd84d519970f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:10.609933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:10.619314 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9be9195a-1d12-4dc8-8d75-ae03e27294a5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1453 microversion: 2.1 time: 0.220504 May 27 03:31:10.620826 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 530/1103] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:10 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:10.639208 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:10.641696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:10.648400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.648905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.649951 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.650483 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.754390 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:10.755105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:10.762562 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.763019 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.763838 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:10.764279 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:10.827992 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:10.837658 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2b6fa8ac-7c0f-4db8-a895-a8fdf7ae17b5 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1453 microversion: 2.1 time: 0.202818 May 27 03:31:10.838241 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 574/1104] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:10 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:10.925275 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:10.935693 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-57965547-3aa5-416a-b605-ed9f64e7839c tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1504 microversion: 2.1 time: 0.185379 May 27 03:31:10.936317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 531/1105] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:10 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:31:11.776257 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:11.777410 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:11.785306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:11.787012 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:11.788024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:11.788780 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:11.810032 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] HTTP exception thrown: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Request method failure captured: May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e HTTP/1.1 May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEQ5bYeg-FJOD-wolyZgCmo6FaNsAXCY0IzoXQXEmFCMoakMYypeBU7eMvNfiNRl3J80WtRraj9PCDIJaV4n7zflP6uES5vhEscJfW-_LKamKCeKz0D4jP_LpT07GMkGGlYTz8bNwM7ZNzI5RAdRVSnymxRfCGrMxOpKR6XnHbemOOQ May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:31:11.812038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: dd9938d83dc84ae494310741e2cba2ec May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.813736 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': 'b54917ef-d32c-4303-99e3-75adc12f147e'} May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:11.814553 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.815813 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:11.818270 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Returning 404 to user: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:11.819313 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bfee4bd5-7790-4aa8-ba46-39eb50efe393 tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 404 len: 111 microversion: 2.20 time: 0.047276 May 27 03:31:11.820487 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 575/1106] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 03:31:11 2022] DELETE /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:11.829661 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:11.830288 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] [instance: b54917ef-d32c-4303-99e3-75adc12f147e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:11.840468 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:11.840923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:11.841727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:11.842161 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:11.857362 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] HTTP exception thrown: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Request method failure captured: May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e HTTP/1.1 May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEQ5bYeg-FJOD-wolyZgCmo6FaNsAXCY0IzoXQXEmFCMoakMYypeBU7eMvNfiNRl3J80WtRraj9PCDIJaV4n7zflP6uES5vhEscJfW-_LKamKCeKz0D4jP_LpT07GMkGGlYTz8bNwM7ZNzI5RAdRVSnymxRfCGrMxOpKR6XnHbemOOQ May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Openstack-Nova-Api-Version: 2.20 May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:31:11.859399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e2e4b63d6af43058e0dc76d8ceac844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 7e2e4b63d6af43058e0dc76d8ceac844 May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481766777 May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: dd9938d83dc84ae494310741e2cba2ec May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481766777-project May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.861153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'b54917ef-d32c-4303-99e3-75adc12f147e'} May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:11.862034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. May 27 03:31:11.863514 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:11.865760 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] Returning 404 to user: Instance b54917ef-d32c-4303-99e3-75adc12f147e could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:11.866813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-46bce331-fe56-4add-acf2-c409b1dbba1f tempest-AttachVolumeShelveTestJSON-1481766777 tempest-AttachVolumeShelveTestJSON-1481766777-project] 10.222.0.50 "GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e" status: 404 len: 111 microversion: 2.20 time: 0.041968 May 27 03:31:11.867541 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 532/1107] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 03:31:11 2022] GET /compute/v2.1/servers/b54917ef-d32c-4303-99e3-75adc12f147e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:31:11.959272 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:11.960563 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:11.971498 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:11.974460 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:11.975506 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:11.978173 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:12.464907 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa92e046c3274a29a8aa8857d7570750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9966ab8ffdcf4e828553261c05fbb5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:12.485165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a5d57a25-565c-4d6e-8b60-39c037d89396 tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 200 len: 1504 microversion: 2.1 time: 0.535210 May 27 03:31:12.486898 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 576/1108] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:11 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 1504 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:12.538972 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-ddbf61d5-7d22-46ee-bba4-5ae3bc835177 req-9cd2434e-bfac-4c57-aca6-7e3e8cb2d91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a177d80-b71b-4add-9c43-0d8aa96c2775", "name": "network-vif-deleted", "tag": "6c4b3a1a-a9f6-4ab6-95ee-23a84f9558f7"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:12.551828 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ddbf61d5-7d22-46ee-bba4-5ae3bc835177 req-9cd2434e-bfac-4c57-aca6-7e3e8cb2d91d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:12.552271 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ddbf61d5-7d22-46ee-bba4-5ae3bc835177 req-9cd2434e-bfac-4c57-aca6-7e3e8cb2d91d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:12.567834 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-ddbf61d5-7d22-46ee-bba4-5ae3bc835177 req-9cd2434e-bfac-4c57-aca6-7e3e8cb2d91d service nova] Creating event network-vif-deleted:6c4b3a1a-a9f6-4ab6-95ee-23a84f9558f7 for instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 on hv-cinder-82880 May 27 03:31:12.574353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-ddbf61d5-7d22-46ee-bba4-5ae3bc835177 req-9cd2434e-bfac-4c57-aca6-7e3e8cb2d91d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040043 May 27 03:31:12.577939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 533/1109] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:13.503727 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:13.504542 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] [instance: 8a177d80-b71b-4add-9c43-0d8aa96c2775] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:13.512664 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:13.513147 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:13.514134 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:13.514596 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:13.530670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] HTTP exception thrown: Instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 could not be found. May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Request method failure captured: May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 HTTP/1.1 May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEXXKRn86wJiKHhPIjEx4FN5tvqkSVR3w8rcxDJujDG-jY1pwxq-JoaXAuRoWAGYnX3I7JAng1Jl6XuZRRWOGk3wHLq-5BcUfas78SwE1zBLw_g8TbowvWwxhsR-vSRcziXMsHwO_YfOdSDkxRwTyykcSSUEtFhZDUSAnGWMR3LfIX8 May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: 9966ab8ffdcf4e828553261c05fbb5a9 May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesActionsTest-193416201 May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:31:13.532222 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9966ab8ffdcf4e828553261c05fbb5a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesActionsTest-193416201 May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 9966ab8ffdcf4e828553261c05fbb5a9 May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesActionsTest-193416201 May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesActionsTest-193416201-project May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: aa92e046c3274a29a8aa8857d7570750 May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesActionsTest-193416201-project May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 could not be found. May 27 03:31:13.533882 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '8a177d80-b71b-4add-9c43-0d8aa96c2775'} May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 could not be found. May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:13.534798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 could not be found. May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 could not be found. May 27 03:31:13.536351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:13.538902 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] Returning 404 to user: Instance 8a177d80-b71b-4add-9c43-0d8aa96c2775 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:13.539988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6e800eb1-f268-439d-a4c1-032f34c8f46f tempest-VolumesActionsTest-193416201 tempest-VolumesActionsTest-193416201-project] 10.222.0.50 "GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775" status: 404 len: 111 microversion: 2.1 time: 0.040159 May 27 03:31:13.541007 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 577/1110] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:13 2022] GET /compute/v2.1/servers/8a177d80-b71b-4add-9c43-0d8aa96c2775 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:31:14.432399 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-4726aed6-714c-4bff-93a1-410596f07cf0 req-723fc3a1-3777-43c7-8c6c-66bb4f6613eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5701149d-2291-4cc6-89a6-b5c50fce46c6", "tag": "b50bb324-6116-4314-8d09-3cd6cc80242f"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:14.444827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4726aed6-714c-4bff-93a1-410596f07cf0 req-723fc3a1-3777-43c7-8c6c-66bb4f6613eb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:14.447566 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4726aed6-714c-4bff-93a1-410596f07cf0 req-723fc3a1-3777-43c7-8c6c-66bb4f6613eb service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:14.466098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-4726aed6-714c-4bff-93a1-410596f07cf0 req-723fc3a1-3777-43c7-8c6c-66bb4f6613eb service nova] Creating event network-changed:b50bb324-6116-4314-8d09-3cd6cc80242f for instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 on hv-cinder-82880 May 27 03:31:14.484109 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-4726aed6-714c-4bff-93a1-410596f07cf0 req-723fc3a1-3777-43c7-8c6c-66bb4f6613eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056157 May 27 03:31:14.488494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 534/1111] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:20.945732 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-865430063"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:20.946484 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:20.955779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:20.956781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:20.957912 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:20.958717 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:21.145610 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.network.security_group_api [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Removing security group 741e00ab-843f-4669-ba88-bc4dfb76ef77 from port bac56807-d1e8-4e80-8e99-25b19600d119 May 27 03:31:21.680846 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-708d2466-6f91-4ae2-95d7-83809fe8238d tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/action" status: 202 len: 0 microversion: 2.1 time: 0.738734 May 27 03:31:21.681908 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 578/1112] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:31:20 2022] POST /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:31:21.700361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-db82e695-1fd6-450d-8428-589bd037197b req-5781c409-38b7-4fcd-95d4-433972b1c548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70020c76-0cc4-4adf-985d-4bd2c1b6b0da", "tag": "bac56807-d1e8-4e80-8e99-25b19600d119"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:21.717006 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-db82e695-1fd6-450d-8428-589bd037197b req-5781c409-38b7-4fcd-95d4-433972b1c548 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:21.721336 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-db82e695-1fd6-450d-8428-589bd037197b req-5781c409-38b7-4fcd-95d4-433972b1c548 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:21.738388 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-db82e695-1fd6-450d-8428-589bd037197b req-5781c409-38b7-4fcd-95d4-433972b1c548 service nova] Creating event network-changed:bac56807-d1e8-4e80-8e99-25b19600d119 for instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da on hv-cinder-82880 May 27 03:31:21.772228 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-db82e695-1fd6-450d-8428-589bd037197b req-5781c409-38b7-4fcd-95d4-433972b1c548 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077866 May 27 03:31:21.778941 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 535/1113] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:31:24.833627 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:24.834226 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:24.836648 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-4e5958a0-b0be-4dba-8ace-5c7c7f4d8e97 req-d162ebfc-2a05-4456-b82b-b3c0db15fce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70020c76-0cc4-4adf-985d-4bd2c1b6b0da", "tag": "bac56807-d1e8-4e80-8e99-25b19600d119"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:24.855919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:24.856143 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:24.862160 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:24.873700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:24.877949 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4e5958a0-b0be-4dba-8ace-5c7c7f4d8e97 req-d162ebfc-2a05-4456-b82b-b3c0db15fce9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:24.878801 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4e5958a0-b0be-4dba-8ace-5c7c7f4d8e97 req-d162ebfc-2a05-4456-b82b-b3c0db15fce9 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:24.914415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-4e5958a0-b0be-4dba-8ace-5c7c7f4d8e97 req-d162ebfc-2a05-4456-b82b-b3c0db15fce9 service nova] Creating event network-changed:bac56807-d1e8-4e80-8e99-25b19600d119 for instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da on hv-cinder-82880 May 27 03:31:24.929348 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-4e5958a0-b0be-4dba-8ace-5c7c7f4d8e97 req-d162ebfc-2a05-4456-b82b-b3c0db15fce9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100158 May 27 03:31:24.937769 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 536/1114] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:25.077872 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lazy-loading 'services' on Instance uuid 70020c76-0cc4-4adf-985d-4bd2c1b6b0da {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:31:25.263400 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b02cc943-8400-48c6-940f-6a419e4c0da8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "DELETE /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments/c6758a74-625e-46e7-8b23-fbf9c1b75651" status: 202 len: 0 microversion: 2.1 time: 0.441230 May 27 03:31:25.264000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 579/1115] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:31:24 2022] DELETE /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments/c6758a74-625e-46e7-8b23-fbf9c1b75651 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:31:25.282453 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6655e7db-7fa8-4074-bbf9-7480a2fd7bf8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:25.283604 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6655e7db-7fa8-4074-bbf9-7480a2fd7bf8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:25.299481 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6655e7db-7fa8-4074-bbf9-7480a2fd7bf8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:25.300104 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6655e7db-7fa8-4074-bbf9-7480a2fd7bf8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:25.302588 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6655e7db-7fa8-4074-bbf9-7480a2fd7bf8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:25.305464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6655e7db-7fa8-4074-bbf9-7480a2fd7bf8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:25.392637 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6655e7db-7fa8-4074-bbf9-7480a2fd7bf8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123461 May 27 03:31:25.396387 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 537/1116] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:31:25 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:26.413742 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-38b9c695-17b9-4781-940e-631c4f86605c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:26.415970 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-38b9c695-17b9-4781-940e-631c4f86605c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:26.423747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38b9c695-17b9-4781-940e-631c4f86605c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:26.425186 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38b9c695-17b9-4781-940e-631c4f86605c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:26.426149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38b9c695-17b9-4781-940e-631c4f86605c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:26.441706 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38b9c695-17b9-4781-940e-631c4f86605c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:26.492191 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:26.514568 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-38b9c695-17b9-4781-940e-631c4f86605c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110969 May 27 03:31:26.526142 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 580/1117] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 03:31:26 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:31:26.537108 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:26.537704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:26.554035 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:26.559565 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:26.562538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:26.563134 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:26.699063 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] HTTP exception thrown: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da is not attached to volume c6758a74-625e-46e7-8b23-fbf9c1b75651 May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Request method failure captured: May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments/c6758a74-625e-46e7-8b23-fbf9c1b75651 HTTP/1.1 May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEVeRuBSzUdhD1vLfVJGr903I9oSocT-seJmAIH0_DCXS8gPy7A0DkdCw8oqxLguJCA56Ho33xNEyACzbIfbDDsyQmfngRwpdeHW4_f5PKxQM3RvOj_2YDr_bZaP6-FWhop6l4JdovhyiYXgxU1LUdLM6JHsyh-HTe3eWwOKUzJTEkE May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: f03723b938b845309929162c81adfe51 May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestMinimumBasicScenario-1066067221 May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:31:26.711934 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f03723b938b845309929162c81adfe51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f03723b938b845309929162c81adfe51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f03723b938b845309929162c81adfe51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f03723b938b845309929162c81adfe51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestMinimumBasicScenario-1066067221 May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: f03723b938b845309929162c81adfe51 May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1066067221 May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-TestMinimumBasicScenario-1066067221-project May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: e38e8354a69642fba0c0949fe5f5dab3 May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestMinimumBasicScenario-1066067221-project May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:31:26.713656 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da is not attached to volume c6758a74-625e-46e7-8b23-fbf9c1b75651 May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'server_id': '70020c76-0cc4-4adf-985d-4bd2c1b6b0da', 'id': 'c6758a74-625e-46e7-8b23-fbf9c1b75651'} May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c6758a74-625e-46e7-8b23-fbf9c1b75651. May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:26.714441 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da is not attached to volume c6758a74-625e-46e7-8b23-fbf9c1b75651 May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da is not attached to volume c6758a74-625e-46e7-8b23-fbf9c1b75651 May 27 03:31:26.715744 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:31:26.718502 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Returning 404 to user: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da is not attached to volume c6758a74-625e-46e7-8b23-fbf9c1b75651 {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:26.719875 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0327a1b5-4ed2-40eb-8817-55e2bfb5bfea tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "DELETE /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments/c6758a74-625e-46e7-8b23-fbf9c1b75651" status: 404 len: 154 microversion: 2.1 time: 0.187547 May 27 03:31:26.722124 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 538/1118] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 03:31:26 2022] DELETE /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da/os-volume_attachments/c6758a74-625e-46e7-8b23-fbf9c1b75651 => generated 154 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:31:27.967393 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:27.967900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:27.975355 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:27.975803 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:27.976568 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:27.977046 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:28.002567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:31:28.090661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f43211ee-3589-42ab-baa9-8d5f7182d9f8 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "DELETE /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 204 len: 0 microversion: 2.1 time: 0.127043 May 27 03:31:28.091584 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 581/1119] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:31:27 2022] DELETE /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:31:28.100019 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:28.101068 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:28.104002 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:28.110041 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:28.110562 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:28.111530 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:28.111974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:28.272906 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:28.288111 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a2af1cfa-c4c1-40b8-8ea1-1066be20e53b tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1554 microversion: 2.1 time: 0.192066 May 27 03:31:28.290669 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 539/1120] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:28 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:31:29.308114 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:29.308854 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:29.316269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:29.316764 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:29.317564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:29.318000 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:29.469050 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:29.476855 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d31990a2-30f5-41b4-8623-d3182c42ad51 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1554 microversion: 2.1 time: 0.173427 May 27 03:31:29.477857 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 582/1121] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:29 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:30.496218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:30.497070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:30.507074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:30.510915 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:30.511979 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:30.513528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:30.758150 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:30.768207 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5abab189-44d2-4be7-86cd-bfc222a3d9fb tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1554 microversion: 2.1 time: 0.276991 May 27 03:31:30.778264 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 540/1122] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:30 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:31.232387 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-61cf4faf-c3f3-49f3-b2fc-f58266b7d360 req-81ca8182-633d-458c-8653-0fd515b2cc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70020c76-0cc4-4adf-985d-4bd2c1b6b0da", "name": "network-vif-deleted", "tag": "bac56807-d1e8-4e80-8e99-25b19600d119"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:31:31.248237 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-61cf4faf-c3f3-49f3-b2fc-f58266b7d360 req-81ca8182-633d-458c-8653-0fd515b2cc2d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:31.253587 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-61cf4faf-c3f3-49f3-b2fc-f58266b7d360 req-81ca8182-633d-458c-8653-0fd515b2cc2d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:31.280113 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-61cf4faf-c3f3-49f3-b2fc-f58266b7d360 req-81ca8182-633d-458c-8653-0fd515b2cc2d service nova] Creating event network-vif-deleted:bac56807-d1e8-4e80-8e99-25b19600d119 for instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da on hv-cinder-82880 May 27 03:31:31.290771 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-61cf4faf-c3f3-49f3-b2fc-f58266b7d360 req-81ca8182-633d-458c-8653-0fd515b2cc2d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065520 May 27 03:31:31.292895 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 583/1123] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:31:31.788703 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:31.789516 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:31.797251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:31.797700 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:31.798500 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:31.798932 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:31.863964 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:31.872218 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-570f3dfb-2107-4d85-ae80-4a784c6bd981 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1512 microversion: 2.1 time: 0.089327 May 27 03:31:31.872778 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 541/1124] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:31 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:32.890682 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:32.891351 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:32.898246 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:32.898696 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:32.899461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:32.899906 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:32.977731 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:32.989248 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6440ac60-45a0-45ae-b50b-c8a3978790fe tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1343 microversion: 2.1 time: 0.103019 May 27 03:31:32.989996 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 584/1125] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:32 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1343 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:34.008343 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:34.009013 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:34.017620 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:34.018382 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:34.019368 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:34.019815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:34.039767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:34.055191 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:34.055644 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:34.056099 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lazy-loading 'fault' on Instance uuid 70020c76-0cc4-4adf-985d-4bd2c1b6b0da {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:31:34.100767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e38e8354a69642fba0c0949fe5f5dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03723b938b845309929162c81adfe51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:31:34.109348 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-47d0b7cf-675a-4899-a3fd-e4867edec3f7 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 200 len: 1348 microversion: 2.1 time: 0.105236 May 27 03:31:34.117933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 542/1126] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:34 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:31:35.126851 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:35.127949 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] [instance: 70020c76-0cc4-4adf-985d-4bd2c1b6b0da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:31:35.135366 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:35.136101 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:35.138279 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:31:35.138905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:31:35.156378 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] HTTP exception thrown: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da could not be found. May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Request method failure captured: May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da HTTP/1.1 May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikEVeRuBSzUdhD1vLfVJGr903I9oSocT-seJmAIH0_DCXS8gPy7A0DkdCw8oqxLguJCA56Ho33xNEyACzbIfbDDsyQmfngRwpdeHW4_f5PKxQM3RvOj_2YDr_bZaP6-FWhop6l4JdovhyiYXgxU1LUdLM6JHsyh-HTe3eWwOKUzJTEkE May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: f03723b938b845309929162c81adfe51 May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-TestMinimumBasicScenario-1066067221 May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:31:35.158370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f03723b938b845309929162c81adfe51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f03723b938b845309929162c81adfe51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f03723b938b845309929162c81adfe51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f03723b938b845309929162c81adfe51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-TestMinimumBasicScenario-1066067221 May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: f03723b938b845309929162c81adfe51 May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1066067221 May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-TestMinimumBasicScenario-1066067221-project May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: e38e8354a69642fba0c0949fe5f5dab3 May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-TestMinimumBasicScenario-1066067221-project May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da could not be found. May 27 03:31:35.161112 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '70020c76-0cc4-4adf-985d-4bd2c1b6b0da'} May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da could not be found. May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:31:35.162834 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da could not be found. May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da could not be found. May 27 03:31:35.167024 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:31:35.174675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Returning 404 to user: Instance 70020c76-0cc4-4adf-985d-4bd2c1b6b0da could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:31:35.174675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e4525d92-8bd2-455a-885e-87ea9024f955 tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da" status: 404 len: 111 microversion: 2.1 time: 0.036976 May 27 03:31:35.174675 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 585/1127] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:31:35 2022] GET /compute/v2.1/servers/70020c76-0cc4-4adf-985d-4bd2c1b6b0da => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:31:35.180676 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e21c1efe-bb2a-4466-99f0-031a8fe46f3c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] Calling method '.version_select at 0x7f5e7418e0d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:31:35.209136 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e21c1efe-bb2a-4466-99f0-031a8fe46f3c tempest-TestMinimumBasicScenario-1066067221 tempest-TestMinimumBasicScenario-1066067221-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-977980413" status: 202 len: 0 microversion: 2.1 time: 0.038559 May 27 03:31:35.210598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 543/1128] 10.222.0.50 () {58 vars in 1268 bytes} [Fri May 27 03:31:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-977980413 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:32:05.957515 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:05.958670 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:06.167836 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-21d4b9c2-27bd-4058-8288-f12167103b59 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Action: 'create', calling method: .version_select at 0x7f5e6f7524c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-697497828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGULLGY3nBMAyIXE+WbqJ3USYMlMN1vTa7oWq4iBhS/HL1hymw35SBCKwOh0slGdjYRmi+BGhKW4yBk4GY8ckCQv2od/St2IXQKDA5JTFj+xxlfsxKSDVILPSfOGciuXTA=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:06.188039 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-21d4b9c2-27bd-4058-8288-f12167103b59 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Getting quotas for project 2bab42aa679b4182887da08409099827. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:32:06.194566 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-21d4b9c2-27bd-4058-8288-f12167103b59 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Getting quotas for user c338d0e7dce9404597cd0061e408091d and project 2bab42aa679b4182887da08409099827. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:32:06.227620 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-21d4b9c2-27bd-4058-8288-f12167103b59 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.278867 May 27 03:32:06.228349 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 586/1129] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 03:32:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:26.873981 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-632676502", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-697497828", "security_groups": [{"name": "tempest-secgroup-smoke-1775821233"}], "networks": [{"uuid": "62ed16ec-a22b-4dfe-b256-e84954389be2"}], "block_device_mapping_v2": [{"uuid": "1163867e-f8eb-471b-9044-18cee1aac0f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:26.882705 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:26.883333 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:26.997083 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] validate_networks() for [('62ed16ec-a22b-4dfe-b256-e84954389be2', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 03:32:27.405236 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 03:32:27.405669 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 03:32:27.406170 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 03:32:27.406583 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 03:32:27.406998 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 03:32:27.416812 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:27.417307 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:27.418117 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:27.418556 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:27.435733 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Getting quotas for project 2bab42aa679b4182887da08409099827. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 03:32:27.440309 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Getting quotas for user c338d0e7dce9404597cd0061e408091d and project 2bab42aa679b4182887da08409099827. Resources: {'instances', 'ram', 'cores'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 03:32:27.502892 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 03:32:27.505061 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1163867e-f8eb-471b-9044-18cee1aac0f7',volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 03:32:27.654140 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-07aa61f5-b2c7-4444-aa8a-45284af2ad77 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784265 May 27 03:32:27.654691 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 544/1130] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 03:32:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:32:27.662249 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:27.663052 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:27.669428 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-985d4776-c16a-4341-8284-3e978fbf7310 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:27.670059 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-985d4776-c16a-4341-8284-3e978fbf7310 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:27.740860 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-985d4776-c16a-4341-8284-3e978fbf7310 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:27.748899 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-985d4776-c16a-4341-8284-3e978fbf7310 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1087 microversion: 2.1 time: 0.087940 May 27 03:32:27.749494 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 587/1131] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:27 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1087 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:28.765819 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:28.766598 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:28.773783 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:28.774434 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:28.775320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:28.775905 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:28.847704 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:28.856685 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d75a0710-3f6a-4fa6-8a68-978657113de3 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1203 microversion: 2.1 time: 0.094865 May 27 03:32:28.857558 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 545/1132] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:28 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1203 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:29.874777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:29.875406 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:29.881610 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:29.882038 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:29.882844 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:29.883286 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:30.035076 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:30.044139 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2ae942e4-e7cd-4a12-8d4b-ed953af8a941 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.173519 May 27 03:32:30.045332 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 588/1133] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:29 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:30.165832 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-452708d8-6dab-4e4d-9f28-d2ce2dc5024c req-a0ed96da-a3bf-4d18-9780-82b0df0f260d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f484296f-054d-43e9-a1ec-62c6868d69e4", "tag": "6892d1c3-9a2a-4cb5-af2d-151b3fdd4873"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:30.180137 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-452708d8-6dab-4e4d-9f28-d2ce2dc5024c req-a0ed96da-a3bf-4d18-9780-82b0df0f260d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:30.180579 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-452708d8-6dab-4e4d-9f28-d2ce2dc5024c req-a0ed96da-a3bf-4d18-9780-82b0df0f260d service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:30.192584 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-452708d8-6dab-4e4d-9f28-d2ce2dc5024c req-a0ed96da-a3bf-4d18-9780-82b0df0f260d service nova] Creating event network-changed:6892d1c3-9a2a-4cb5-af2d-151b3fdd4873 for instance f484296f-054d-43e9-a1ec-62c6868d69e4 on hv-cinder-82880 May 27 03:32:30.198121 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-452708d8-6dab-4e4d-9f28-d2ce2dc5024c req-a0ed96da-a3bf-4d18-9780-82b0df0f260d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035820 May 27 03:32:30.199494 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 546/1134] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:31.065302 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:31.065883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:31.072866 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:31.073446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:31.074426 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:31.074725 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:31.212151 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:31.220176 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-42f15143-cafd-483a-ba95-417c8e3bc5f8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.161255 May 27 03:32:31.221533 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 589/1135] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:31 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:32.242670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:32.243418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:32.251534 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:32.251978 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:32.252734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:32.253208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:32.397655 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:32.407820 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d480a632-1b25-4e2e-8d0d-d0a4db2cff0e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.172763 May 27 03:32:32.408353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 547/1136] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:32 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:33.426284 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:33.426956 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:33.436510 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.437209 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:33.438480 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:33.439056 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:33.583316 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:33.593885 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8de839b3-b56e-4632-8da9-c448b5fd1e5e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.173329 May 27 03:32:33.594452 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 590/1137] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:33 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:34.614827 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:34.615715 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:34.625344 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:34.625804 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:34.626575 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:34.627015 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:34.771611 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:34.783228 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9351fd9b-a44d-4bef-a43e-a44bd0d4ebb9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.174990 May 27 03:32:34.783890 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 548/1138] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:34 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:35.808158 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:35.809452 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:35.820649 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:35.821429 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:35.822701 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:35.823430 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:35.962499 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:35.970800 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ee7d1bd5-6ff1-43f7-99ca-22d2a8e5183a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.169109 May 27 03:32:35.971383 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 591/1139] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:35 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:36.988172 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:36.988813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:36.996034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:36.996485 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:36.997298 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:36.997734 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:37.161735 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:37.174447 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d0a68224-fb7c-4767-98dd-d7e374eeee6e tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.190672 May 27 03:32:37.175098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 549/1140] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:36 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:38.197891 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:38.198538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:38.201343 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:38.207022 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:38.207508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:38.208306 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:38.208747 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:38.348806 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:38.356567 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bc1a7ff1-d1a8-465f-acb2-aa4b99361652 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.163372 May 27 03:32:38.357163 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 592/1141] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:38 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:39.374721 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:39.375291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:39.377316 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:39.377973 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:39.384326 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:39.384766 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:39.385544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:39.386317 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:39.528812 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:39.536604 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3a3694c4-b055-47ba-83c0-71d32848b751 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.166109 May 27 03:32:39.537609 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 550/1142] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:39 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:40.562728 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:40.562728 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:40.572900 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:40.573568 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:40.574782 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:40.575411 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:40.732823 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:40.744461 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9aa6ce37-f40b-4785-8f7a-b02acb2553b5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.193317 May 27 03:32:40.745353 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 593/1143] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:40 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:41.319372 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-ee674bf9-4a26-4adb-bd13-37a73e1db4a8 req-f4725e3a-8576-4599-9587-a48a7a394803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f484296f-054d-43e9-a1ec-62c6868d69e4", "name": "network-vif-plugged", "status": "completed", "tag": "6892d1c3-9a2a-4cb5-af2d-151b3fdd4873"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:41.329400 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ee674bf9-4a26-4adb-bd13-37a73e1db4a8 req-f4725e3a-8576-4599-9587-a48a7a394803 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:41.329821 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ee674bf9-4a26-4adb-bd13-37a73e1db4a8 req-f4725e3a-8576-4599-9587-a48a7a394803 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:41.341376 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-ee674bf9-4a26-4adb-bd13-37a73e1db4a8 req-f4725e3a-8576-4599-9587-a48a7a394803 service nova] Creating event network-vif-plugged:6892d1c3-9a2a-4cb5-af2d-151b3fdd4873 for instance f484296f-054d-43e9-a1ec-62c6868d69e4 on hv-cinder-82880 May 27 03:32:41.346503 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-ee674bf9-4a26-4adb-bd13-37a73e1db4a8 req-f4725e3a-8576-4599-9587-a48a7a394803 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030837 May 27 03:32:41.347080 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 551/1144] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:41.767693 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:41.768347 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:41.775625 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:41.776099 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:41.776905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:41.777401 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:41.916174 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:41.925145 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b258c50d-e57c-4256-965d-41ad167cbdbc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1259 microversion: 2.1 time: 0.163876 May 27 03:32:41.925750 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 594/1145] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:41 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:42.946520 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:42.947177 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:42.954493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:42.955098 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:42.955856 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:42.956292 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:43.095075 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:43.105431 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-95be882e-f888-48eb-b2de-313d0f25728f tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1443 microversion: 2.1 time: 0.163510 May 27 03:32:43.106291 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 552/1146] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:42 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:43.124262 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:43.125079 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:43.132418 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:43.132870 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:43.133661 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:43.134106 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:43.268304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:43.276361 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-604fed39-23af-4973-b2cd-21f8533c6d1c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1443 microversion: 2.1 time: 0.157777 May 27 03:32:43.276938 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 595/1147] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:43 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:45.477507 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-79baafb6-165b-4907-adf5-30fda83ef38f req-94a41578-da41-40a7-ba7d-afeba7150236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f484296f-054d-43e9-a1ec-62c6868d69e4", "tag": "6892d1c3-9a2a-4cb5-af2d-151b3fdd4873"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:45.486115 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-79baafb6-165b-4907-adf5-30fda83ef38f req-94a41578-da41-40a7-ba7d-afeba7150236 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:45.486638 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-79baafb6-165b-4907-adf5-30fda83ef38f req-94a41578-da41-40a7-ba7d-afeba7150236 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:45.500176 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-79baafb6-165b-4907-adf5-30fda83ef38f req-94a41578-da41-40a7-ba7d-afeba7150236 service nova] Creating event network-changed:6892d1c3-9a2a-4cb5-af2d-151b3fdd4873 for instance f484296f-054d-43e9-a1ec-62c6868d69e4 on hv-cinder-82880 May 27 03:32:45.505260 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-79baafb6-165b-4907-adf5-30fda83ef38f req-94a41578-da41-40a7-ba7d-afeba7150236 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031445 May 27 03:32:45.506074 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 553/1148] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:57.158138 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:57.159353 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:57.160773 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-87a0525e-fbbc-49c1-b0ba-d9cd8c91ccd0 req-574ce234-6937-414d-acc8-32f68054db25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5701149d-2291-4cc6-89a6-b5c50fce46c6", "tag": "b50bb324-6116-4314-8d09-3cd6cc80242f"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:57.162827 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=20 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:57.163622 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=48 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:57.170312 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.171144 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.171277 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:57.171596 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.172256 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=44 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:57.172460 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.175937 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-87a0525e-fbbc-49c1-b0ba-d9cd8c91ccd0 req-574ce234-6937-414d-acc8-32f68054db25 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.176632 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-87a0525e-fbbc-49c1-b0ba-d9cd8c91ccd0 req-574ce234-6937-414d-acc8-32f68054db25 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.191303 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-87a0525e-fbbc-49c1-b0ba-d9cd8c91ccd0 req-574ce234-6937-414d-acc8-32f68054db25 service nova] Creating event network-changed:b50bb324-6116-4314-8d09-3cd6cc80242f for instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 on hv-cinder-82880 May 27 03:32:57.197911 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-87a0525e-fbbc-49c1-b0ba-d9cd8c91ccd0 req-574ce234-6937-414d-acc8-32f68054db25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042111 May 27 03:32:57.199164 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 554/1149] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:57.210669 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:32:57.313221 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-46c882bc-7bad-4558-8aa8-c7b1289d100f tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 204 len: 0 microversion: 2.1 time: 0.158905 May 27 03:32:57.314196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 596/1150] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:32:57 2022] DELETE /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:32:57.323484 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:57.324226 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:57.330706 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.331170 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.331989 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:57.332479 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:57.493430 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:57.501464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3520c73a-8966-49ac-9e08-68483dbb53e1 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1577 microversion: 2.1 time: 0.182627 May 27 03:32:57.502154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 555/1151] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:57 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:32:58.523804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:58.524700 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:58.532919 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:58.534317 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:58.535779 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:58.536238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:58.676438 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:58.684182 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-333901bb-5580-4e33-b69c-ffcefba54ff7 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1577 microversion: 2.1 time: 0.166597 May 27 03:32:58.684755 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 597/1152] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:58 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:32:59.614836 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-c1459aad-542e-4dd2-972d-e6c9f373cb90 req-4629570a-850a-448b-a7a1-4354cbcac2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5701149d-2291-4cc6-89a6-b5c50fce46c6", "name": "network-vif-deleted", "tag": "b50bb324-6116-4314-8d09-3cd6cc80242f"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:32:59.624251 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c1459aad-542e-4dd2-972d-e6c9f373cb90 req-4629570a-850a-448b-a7a1-4354cbcac2ae service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:59.624696 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c1459aad-542e-4dd2-972d-e6c9f373cb90 req-4629570a-850a-448b-a7a1-4354cbcac2ae service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:59.637203 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-c1459aad-542e-4dd2-972d-e6c9f373cb90 req-4629570a-850a-448b-a7a1-4354cbcac2ae service nova] Creating event network-vif-deleted:b50bb324-6116-4314-8d09-3cd6cc80242f for instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 on hv-cinder-82880 May 27 03:32:59.642329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-c1459aad-542e-4dd2-972d-e6c9f373cb90 req-4629570a-850a-448b-a7a1-4354cbcac2ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031896 May 27 03:32:59.643031 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 556/1153] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:59.704787 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:59.705771 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:32:59.713227 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:59.713666 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:59.714399 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:32:59.714850 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:32:59.782769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:32:59.790470 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-39e0760c-1870-444e-a005-23ee61c86e40 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 200 len: 1224 microversion: 2.1 time: 0.092101 May 27 03:32:59.791064 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 598/1154] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:32:59 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:00.813298 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:00.814450 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5701149d-2291-4cc6-89a6-b5c50fce46c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:00.822001 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:00.822448 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:00.823208 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:00.823627 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:00.837690 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] HTTP exception thrown: Instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 could not be found. May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Request method failure captured: May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 HTTP/1.1 May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikERaV10kgaA5xz2Gpv0AIVykracYjCaosXJElTjQaqAaPXyBgmBobK7AyyTHGE64WsqMLFsQ-EHbPAfSDffhNS3e2_dHu1YtNIL-Ze8SvcSdPRazTshnWUsTYrfio3MYqOj-KfOl2fMzcCH4p61RLgXujbQ9uJAbVz08jgpEyedVSw0 May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:33:00.839329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5bef1b49d424299864523887eb72b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 01be6ea7136e45aead352146193f05ed May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 could not be found. May 27 03:33:00.840974 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '5701149d-2291-4cc6-89a6-b5c50fce46c6'} May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 could not be found. May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:33:00.842094 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 could not be found. May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 could not be found. May 27 03:33:00.843498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:00.844897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Returning 404 to user: Instance 5701149d-2291-4cc6-89a6-b5c50fce46c6 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:33:00.844897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0ddd0bd5-7f80-4b57-aa53-67b3e33e1179 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6" status: 404 len: 111 microversion: 2.1 time: 0.034770 May 27 03:33:00.844897 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 557/1155] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:33:00 2022] GET /compute/v2.1/servers/5701149d-2291-4cc6-89a6-b5c50fce46c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:33:03.940238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:03.940790 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:03.942008 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-697a37c6-42cd-4929-815b-7ab1ab65735f req-f4129d22-652b-40c1-ad79-6eaefd819d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbdd423-cd44-475e-abb9-2c765b71b978", "tag": "500f9575-c4a4-47bd-be17-a054e686429b"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:03.947464 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:03.948151 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:03.949086 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:03.950295 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:03.951012 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-697a37c6-42cd-4929-815b-7ab1ab65735f req-f4129d22-652b-40c1-ad79-6eaefd819d87 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:03.951449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-697a37c6-42cd-4929-815b-7ab1ab65735f req-f4129d22-652b-40c1-ad79-6eaefd819d87 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:03.963469 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-697a37c6-42cd-4929-815b-7ab1ab65735f req-f4129d22-652b-40c1-ad79-6eaefd819d87 service nova] Creating event network-changed:500f9575-c4a4-47bd-be17-a054e686429b for instance 5bbdd423-cd44-475e-abb9-2c765b71b978 on hv-cinder-82880 May 27 03:33:03.969298 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-697a37c6-42cd-4929-815b-7ab1ab65735f req-f4129d22-652b-40c1-ad79-6eaefd819d87 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030889 May 27 03:33:03.970201 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 558/1156] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:33:03.980977 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:33:04.077577 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4b9256e1-2233-4b6f-979b-fb7c132ce772 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 204 len: 0 microversion: 2.1 time: 0.139580 May 27 03:33:04.078601 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 599/1157] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:33:03 2022] DELETE /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:33:04.087459 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:04.088207 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:04.094741 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:04.095835 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:04.096033 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:04.096418 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:04.269258 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:04.277237 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f990e989-cea9-4dbb-b061-c663723962c4 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1575 microversion: 2.1 time: 0.194162 May 27 03:33:04.277871 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 559/1158] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:33:04 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:05.295500 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:05.296446 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:05.303482 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:05.303936 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:05.304703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:05.305178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:05.444991 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:05.453224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3b1bd0d3-5e28-48ea-ab93-db600b70f6c3 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1575 microversion: 2.1 time: 0.161996 May 27 03:33:05.453768 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 600/1159] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:33:05 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:06.286353 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-170242fd-ce2a-4979-a786-be2391864662 req-d6431248-df00-4623-bd07-b881ae64f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbdd423-cd44-475e-abb9-2c765b71b978", "name": "network-vif-deleted", "tag": "500f9575-c4a4-47bd-be17-a054e686429b"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:33:06.296489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-170242fd-ce2a-4979-a786-be2391864662 req-d6431248-df00-4623-bd07-b881ae64f923 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:06.296939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-170242fd-ce2a-4979-a786-be2391864662 req-d6431248-df00-4623-bd07-b881ae64f923 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:06.308923 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-170242fd-ce2a-4979-a786-be2391864662 req-d6431248-df00-4623-bd07-b881ae64f923 service nova] Creating event network-vif-deleted:500f9575-c4a4-47bd-be17-a054e686429b for instance 5bbdd423-cd44-475e-abb9-2c765b71b978 on hv-cinder-82880 May 27 03:33:06.313775 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-170242fd-ce2a-4979-a786-be2391864662 req-d6431248-df00-4623-bd07-b881ae64f923 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031216 May 27 03:33:06.314977 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 560/1160] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:33:06.472280 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:06.472864 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:06.482892 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:06.483370 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:06.484338 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:06.484852 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:06.549828 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01be6ea7136e45aead352146193f05ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bef1b49d424299864523887eb72b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:33:06.558136 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f31d81c3-3301-4084-8c53-0e69fe5ade41 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 200 len: 1224 microversion: 2.1 time: 0.090183 May 27 03:33:06.558723 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 601/1161] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:33:06 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:33:07.581004 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:07.582023 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 5bbdd423-cd44-475e-abb9-2c765b71b978] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:07.592253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:07.593019 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:07.594336 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:07.595070 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:07.610270 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] HTTP exception thrown: Instance 5bbdd423-cd44-475e-abb9-2c765b71b978 could not be found. May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Request method failure captured: May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 HTTP/1.1 May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikERaV10kgaA5xz2Gpv0AIVykracYjCaosXJElTjQaqAaPXyBgmBobK7AyyTHGE64WsqMLFsQ-EHbPAfSDffhNS3e2_dHu1YtNIL-Ze8SvcSdPRazTshnWUsTYrfio3MYqOj-KfOl2fMzcCH4p61RLgXujbQ9uJAbVz08jgpEyedVSw0 May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:33:07.611891 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5bef1b49d424299864523887eb72b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 01be6ea7136e45aead352146193f05ed May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 5bbdd423-cd44-475e-abb9-2c765b71b978 could not be found. May 27 03:33:07.613518 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '5bbdd423-cd44-475e-abb9-2c765b71b978'} May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bbdd423-cd44-475e-abb9-2c765b71b978 could not be found. May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:33:07.614839 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bbdd423-cd44-475e-abb9-2c765b71b978 could not be found. May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bbdd423-cd44-475e-abb9-2c765b71b978 could not be found. May 27 03:33:07.616765 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:07.618321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Returning 404 to user: Instance 5bbdd423-cd44-475e-abb9-2c765b71b978 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:33:07.618321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1f777d51-c891-418e-acd2-9a55057fdb46 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978" status: 404 len: 111 microversion: 2.1 time: 0.040772 May 27 03:33:07.618321 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 561/1162] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:33:07 2022] GET /compute/v2.1/servers/5bbdd423-cd44-475e-abb9-2c765b71b978 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:33:08.070178 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:08.070683 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:08.077781 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.078235 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.079002 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.079439 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.093190 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] HTTP exception thrown: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Request method failure captured: May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 HTTP/1.1 May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept: application/json May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Connection: close May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Length: 0 May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Content-Type: application/json May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Host: 10.222.0.50 May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABikERaV10kgaA5xz2Gpv0AIVykracYjCaosXJElTjQaqAaPXyBgmBobK7AyyTHGE64WsqMLFsQ-EHbPAfSDffhNS3e2_dHu1YtNIL-Ze8SvcSdPRazTshnWUsTYrfio3MYqOj-KfOl2fMzcCH4p61RLgXujbQ9uJAbVz08jgpEyedVSw0 May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Id: None May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Domain-Name: None May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Role: member,reader May 27 03:33:08.094825 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Roles: member,reader May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5bef1b49d424299864523887eb72b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Id: 01be6ea7136e45aead352146193f05ed May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: method: > May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: exception: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.096523 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: action_args: {'id': '31f03d50-8598-4db5-b3fd-ee77a878c5e4'} May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:33:08.097447 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.098766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi May 27 03:33:08.101089 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Returning 404 to user: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:33:08.101089 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2f05e4c8-9326-42f9-8f8a-49193977e645 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "DELETE /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 404 len: 111 microversion: 2.1 time: 0.030037 May 27 03:33:08.101089 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 602/1163] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:33:08 2022] DELETE /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:33:08.105124 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:08.105726 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] [instance: 31f03d50-8598-4db5-b3fd-ee77a878c5e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:33:08.111806 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.112245 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.113036 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:33:08.113449 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:33:08.126970 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] HTTP exception thrown: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Request method failure captured: May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 HTTP/1.1 May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikERaV10kgaA5xz2Gpv0AIVykracYjCaosXJElTjQaqAaPXyBgmBobK7AyyTHGE64WsqMLFsQ-EHbPAfSDffhNS3e2_dHu1YtNIL-Ze8SvcSdPRazTshnWUsTYrfio3MYqOj-KfOl2fMzcCH4p61RLgXujbQ9uJAbVz08jgpEyedVSw0 May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:33:08.128474 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d5bef1b49d424299864523887eb72b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d5bef1b49d424299864523887eb72b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: d5bef1b49d424299864523887eb72b3c May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1900631948 May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: 01be6ea7136e45aead352146193f05ed May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestVolumeBootPattern-1900631948-project May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.130282 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': '31f03d50-8598-4db5-b3fd-ee77a878c5e4'} May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:33:08.131489 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. May 27 03:33:08.133059 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:33:08.134634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Returning 404 to user: Instance 31f03d50-8598-4db5-b3fd-ee77a878c5e4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:33:08.134634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b48ce357-487d-40eb-a5fd-3e549ffcdd94 tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4" status: 404 len: 111 microversion: 2.1 time: 0.028622 May 27 03:33:08.134634 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 562/1164] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:33:08 2022] GET /compute/v2.1/servers/31f03d50-8598-4db5-b3fd-ee77a878c5e4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:33:09.446121 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9b44bb00-aa3b-436e-ba24-2bbee5b86c5e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] Calling method '.version_select at 0x7f5e6f64c9d0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:33:09.465897 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9b44bb00-aa3b-436e-ba24-2bbee5b86c5e tempest-TestVolumeBootPattern-1900631948 tempest-TestVolumeBootPattern-1900631948-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-940256736" status: 202 len: 0 microversion: 2.1 time: 0.023635 May 27 03:33:09.466766 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 603/1165] 10.222.0.50 () {58 vars in 1259 bytes} [Fri May 27 03:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-940256736 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:33:35.000735 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:33:35.001389 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Fri May 27 03:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:34:37.831252 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=18 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:37.832196 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=26 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:37.838967 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:37.839831 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:37.848566 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:37.849054 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:37.849815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:37.850248 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:37.880917 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lazy-loading 'flavor' on Instance uuid f484296f-054d-43e9-a1ec-62c6868d69e4 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 03:34:37.980182 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-048351a7-e631-4a1c-ba97-444c793db1fe tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "POST /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4/action" status: 202 len: 0 microversion: 2.1 time: 0.151742 May 27 03:34:37.980794 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 563/1166] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:34:37 2022] POST /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:34:37.988184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:37.989039 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:37.993858 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:37.994564 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:38.003315 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:38.003788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:38.003788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:38.003788 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:38.318505 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:38.329614 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-caa2159f-a058-4020-af64-1bc2a60ab8f5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.344358 May 27 03:34:38.330196 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 604/1167] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:37 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:39.348799 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:39.349522 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:39.357097 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:39.357527 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:39.358297 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:39.358739 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:39.555757 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:39.565877 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1f51454a-bf83-4553-b3b4-7a25af56d112 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.221091 May 27 03:34:39.566670 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 564/1168] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:39 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:40.587926 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:40.588772 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:40.599662 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:40.600397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:40.601698 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:40.602409 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:40.739559 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:40.747753 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d2d0be13-d5b7-4a70-b0ae-96f0d8378fd9 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.166726 May 27 03:34:40.748312 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 605/1169] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:40 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:41.774787 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:41.775717 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:41.784414 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:41.784908 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:41.785702 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:41.786154 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:41.946608 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:41.955362 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-492ba877-6485-4c67-b63e-571eec7454ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.187224 May 27 03:34:41.955939 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 565/1170] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:41 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:42.981246 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:42.982238 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:42.989946 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:42.990397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:42.991165 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:42.991599 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:43.151685 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:43.161223 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-059b4400-b7ad-4ba5-8a88-b024ea48a273 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.186505 May 27 03:34:43.161798 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 606/1171] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:42 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:44.179042 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:44.179667 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:44.186269 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:44.186720 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:44.187488 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:44.187941 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:44.336842 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:44.348751 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ac7b32f7-f6d6-48e2-af78-85498852ec9a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.173299 May 27 03:34:44.349725 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 566/1172] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:44 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:45.373374 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:45.374304 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:45.381883 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:45.382336 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:45.383099 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:45.383536 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:45.532818 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:45.540862 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4e93aa2f-4611-4ea5-998d-c1a859f99fcf tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.173561 May 27 03:34:45.541479 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 607/1173] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:45 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:46.558538 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:46.559110 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:46.566361 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:46.566813 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:46.567577 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:46.568012 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:46.710860 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:46.718969 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-023815aa-1158-4fca-a30e-4c78ba9db620 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.164499 May 27 03:34:46.719513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 567/1174] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:46 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:47.740288 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:47.740890 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:47.751051 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:47.751397 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:47.752346 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:47.752776 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:47.899757 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:47.907752 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-181b7f2a-1da0-4b94-a26e-bfa96c3d027b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.173751 May 27 03:34:47.908329 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 608/1175] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:47 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:48.926323 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:48.926962 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:48.936899 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:48.937578 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:48.939058 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:48.940498 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:49.093710 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:49.102105 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d1048334-5e08-42e5-9592-3d1010c3246c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.179820 May 27 03:34:49.102672 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 568/1176] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:48 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:50.123684 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:50.124644 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:50.136624 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:50.137429 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:50.138695 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:50.139373 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:50.287983 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:50.300604 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a7d8bf75-5ce3-47f9-bcc7-09640e3a3253 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.183483 May 27 03:34:50.301448 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 609/1177] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:50 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:51.325801 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:51.326389 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:51.335499 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:51.336341 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:51.337491 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:51.338053 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:51.478506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:51.490234 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e770e9e8-ee2d-4f6e-b3dc-2e6e1e72de62 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1509 microversion: 2.1 time: 0.170487 May 27 03:34:51.491025 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 569/1178] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:51 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:51.513457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-045ae550-f836-413b-940c-abba11fa28cc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:51.514030 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-045ae550-f836-413b-940c-abba11fa28cc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:51.524989 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-045ae550-f836-413b-940c-abba11fa28cc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:51.525628 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-045ae550-f836-413b-940c-abba11fa28cc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:51.526703 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-045ae550-f836-413b-940c-abba11fa28cc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:51.527334 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-045ae550-f836-413b-940c-abba11fa28cc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:51.614015 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-045ae550-f836-413b-940c-abba11fa28cc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "POST /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4/action" status: 202 len: 0 microversion: 2.1 time: 0.106573 May 27 03:34:51.614545 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 610/1179] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 03:34:51 2022] POST /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:34:51.622668 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:51.623286 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:51.629424 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:51.629883 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:51.630653 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:51.631093 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:51.771745 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:51.779506 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-555d8b44-926b-44ca-b8d9-6267520e505a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1517 microversion: 2.1 time: 0.160713 May 27 03:34:51.780085 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 570/1180] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:51 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:52.803711 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:52.804749 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:52.816237 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:52.816743 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:52.817601 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:52.818066 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:52.964969 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:52.972820 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-589e7c55-9ff6-491f-837a-205beee49faa tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1519 microversion: 2.1 time: 0.178395 May 27 03:34:52.973508 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 611/1181] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:52 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:53.911327 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-4c2fac8b-7de2-48e4-92e6-4276550c59a5 req-a12dea0e-cbbc-4585-85e7-58b7184dad4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f484296f-054d-43e9-a1ec-62c6868d69e4", "name": "network-vif-unplugged", "status": "completed", "tag": "6892d1c3-9a2a-4cb5-af2d-151b3fdd4873"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:53.919515 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4c2fac8b-7de2-48e4-92e6-4276550c59a5 req-a12dea0e-cbbc-4585-85e7-58b7184dad4f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:53.920202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4c2fac8b-7de2-48e4-92e6-4276550c59a5 req-a12dea0e-cbbc-4585-85e7-58b7184dad4f service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:53.933381 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-4c2fac8b-7de2-48e4-92e6-4276550c59a5 req-a12dea0e-cbbc-4585-85e7-58b7184dad4f service nova] Creating event network-vif-unplugged:6892d1c3-9a2a-4cb5-af2d-151b3fdd4873 for instance f484296f-054d-43e9-a1ec-62c6868d69e4 on hv-cinder-82880 May 27 03:34:53.938910 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-4c2fac8b-7de2-48e4-92e6-4276550c59a5 req-a12dea0e-cbbc-4585-85e7-58b7184dad4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099788 May 27 03:34:53.940090 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 571/1182] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:53.990905 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:53.991491 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:53.998217 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:53.998690 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:53.999460 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:53.999894 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:54.138157 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:54.146667 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a14a9bf2-de17-4d90-b2fc-33a198e5c58c tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1575 microversion: 2.1 time: 0.159685 May 27 03:34:54.147246 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 612/1183] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:53 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:55.166413 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:55.167183 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:55.174545 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:55.175091 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:55.175930 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:55.176414 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:55.325858 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:55.334544 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-abb9592f-fe65-4271-b44f-e544e7576b80 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1575 microversion: 2.1 time: 0.173377 May 27 03:34:55.335126 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 572/1184] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:55 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:56.358837 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:56.359863 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:56.368740 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:56.369224 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:56.369988 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:56.370427 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:56.516477 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:56.525324 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-de037e75-a448-49db-b3d9-60a792915938 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1575 microversion: 2.1 time: 0.173175 May 27 03:34:56.525944 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 613/1185] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:56 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:57.549995 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:57.550815 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:57.557887 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:57.558349 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:57.559123 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:57.559568 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:57.707508 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:57.715718 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f2df7dd7-97bc-44bc-8219-e8829d36dbea tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1575 microversion: 2.1 time: 0.172062 May 27 03:34:57.716287 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 573/1186] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:57 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:58.738267 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:58.738939 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:58.745929 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:58.746388 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:58.747149 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:58.747590 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:58.888594 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:34:58.901921 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-58239354-ad1b-46c9-b2ff-264988290d3a tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1575 microversion: 2.1 time: 0.167300 May 27 03:34:58.902785 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 614/1187] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:58 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:59.926480 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:59.927444 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:34:59.934727 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:59.935202 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:34:59.936009 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:34:59.936464 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:00.071084 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:00.078933 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-344c2a94-7ad0-4b01-8a9d-faa69c1da23b tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1575 microversion: 2.1 time: 0.159355 May 27 03:35:00.079512 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 574/1188] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:34:59 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:01.097756 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:01.098494 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:01.105354 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:01.105804 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:01.106615 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:01.107057 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:01.247770 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:01.255777 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-73339285-01d0-4607-904c-ff56b39d41dc tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1575 microversion: 2.1 time: 0.163762 May 27 03:35:01.256276 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 615/1189] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:35:01 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:02.275127 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:02.275684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:35:02.282698 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:02.283153 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:02.283902 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:02.284329 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:02.422311 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:35:02.430542 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-39187891-2a97-4670-b785-62904eb10df6 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1562 microversion: 2.1 time: 0.160355 May 27 03:35:02.441342 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 575/1190] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:35:02 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:03.945457 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-9c5ee40d-c17c-48a0-b2d7-d21838c46d19 req-2826be4c-e4b2-404c-8730-8dc5772efcbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f484296f-054d-43e9-a1ec-62c6868d69e4", "name": "network-vif-plugged", "status": "completed", "tag": "6892d1c3-9a2a-4cb5-af2d-151b3fdd4873"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:03.954184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-9c5ee40d-c17c-48a0-b2d7-d21838c46d19 req-2826be4c-e4b2-404c-8730-8dc5772efcbd service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:35:03.954636 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-9c5ee40d-c17c-48a0-b2d7-d21838c46d19 req-2826be4c-e4b2-404c-8730-8dc5772efcbd service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:35:03.966896 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-9c5ee40d-c17c-48a0-b2d7-d21838c46d19 req-2826be4c-e4b2-404c-8730-8dc5772efcbd service nova] Creating event network-vif-plugged:6892d1c3-9a2a-4cb5-af2d-151b3fdd4873 for instance f484296f-054d-43e9-a1ec-62c6868d69e4 on hv-cinder-82880 May 27 03:35:03.972127 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-9c5ee40d-c17c-48a0-b2d7-d21838c46d19 req-2826be4c-e4b2-404c-8730-8dc5772efcbd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 May 27 03:35:03.972699 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 616/1191] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:59.884195 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:35:59.885485 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Fri May 27 03:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:36:15.349697 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=28 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:15.350320 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:15.350963 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:15.351151 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:15.353415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=26 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:15.354237 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:15.362252 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.362976 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.363763 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.364357 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.392030 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 03:36:15.473238 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bf60422d-9849-461f-9fa4-2fafe2e74c31 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 204 len: 0 microversion: 2.1 time: 0.127955 May 27 03:36:15.476919 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 576/1192] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 03:36:15 2022] DELETE /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:36:15.483415 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:15.484209 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:15.491123 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.491580 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.492422 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.492873 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.496763 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-d0700c43-4212-45d3-bf92-16905592db94 req-169d3b81-93de-42c6-9850-5d0b2d087eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f484296f-054d-43e9-a1ec-62c6868d69e4", "tag": "6892d1c3-9a2a-4cb5-af2d-151b3fdd4873"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:15.505198 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-d0700c43-4212-45d3-bf92-16905592db94 req-169d3b81-93de-42c6-9850-5d0b2d087eb3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:15.506379 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-d0700c43-4212-45d3-bf92-16905592db94 req-169d3b81-93de-42c6-9850-5d0b2d087eb3 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:15.519269 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-d0700c43-4212-45d3-bf92-16905592db94 req-169d3b81-93de-42c6-9850-5d0b2d087eb3 service nova] Creating event network-changed:6892d1c3-9a2a-4cb5-af2d-151b3fdd4873 for instance f484296f-054d-43e9-a1ec-62c6868d69e4 on hv-cinder-82880 May 27 03:36:15.524419 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-d0700c43-4212-45d3-bf92-16905592db94 req-169d3b81-93de-42c6-9850-5d0b2d087eb3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176639 May 27 03:36:15.525140 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 617/1193] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:15.636943 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:15.645253 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3fe385eb-2715-4beb-9f61-9a5d247eee27 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.166225 May 27 03:36:15.645849 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 577/1194] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:36:15 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:16.664173 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:16.664769 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:16.672090 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:16.672538 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.673344 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:16.673778 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:16.815931 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:16.824416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0d794b6a-39e0-46b4-b8e0-dbb011a778ca tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1568 microversion: 2.1 time: 0.165017 May 27 03:36:16.824922 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 618/1195] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:36:16 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:17.841319 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:17.842034 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:17.848980 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:17.849440 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:17.850217 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:17.850631 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:17.927513 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c338d0e7dce9404597cd0061e408091d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bab42aa679b4182887da08409099827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:36:17.935833 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d431d93d-d8b0-4566-a6d8-a569d3fa5540 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 200 len: 1381 microversion: 2.1 time: 0.098792 May 27 03:36:17.936416 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 578/1196] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:36:17 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 1381 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:36:17.949396 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-2e953075-d2a0-4cf9-a6f0-5ea50ae9e383 req-47efed54-741b-45aa-98c2-e825b47e2845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f484296f-054d-43e9-a1ec-62c6868d69e4", "name": "network-vif-deleted", "tag": "6892d1c3-9a2a-4cb5-af2d-151b3fdd4873"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:36:17.957741 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2e953075-d2a0-4cf9-a6f0-5ea50ae9e383 req-47efed54-741b-45aa-98c2-e825b47e2845 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:17.958184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2e953075-d2a0-4cf9-a6f0-5ea50ae9e383 req-47efed54-741b-45aa-98c2-e825b47e2845 service nova] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:17.969010 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-2e953075-d2a0-4cf9-a6f0-5ea50ae9e383 req-47efed54-741b-45aa-98c2-e825b47e2845 service nova] Creating event network-vif-deleted:6892d1c3-9a2a-4cb5-af2d-151b3fdd4873 for instance f484296f-054d-43e9-a1ec-62c6868d69e4 on hv-cinder-82880 May 27 03:36:17.973754 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-2e953075-d2a0-4cf9-a6f0-5ea50ae9e383 req-47efed54-741b-45aa-98c2-e825b47e2845 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136540 May 27 03:36:17.974416 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 619/1197] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 03:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:36:18.953526 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:18.954128 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] [instance: f484296f-054d-43e9-a1ec-62c6868d69e4] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 03:36:18.961073 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:18.961736 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:18.962493 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 03:36:18.962928 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Lock "c3177609-63d6-4369-942a-1c4f9ce92a70" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 03:36:18.977571 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] HTTP exception thrown: Instance f484296f-054d-43e9-a1ec-62c6868d69e4 could not be found. May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Request method failure captured: May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 HTTP/1.1 May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept: application/json May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Connection: close May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Length: 0 May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Content-Type: application/json May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Host: 10.222.0.50 May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABikEYvDhgdmth_BzPH36bsnfucOUVhR50NyslNFUPKwo6qgZ5-Gda4FM--gIFfR3Jr9R9UgeweXVFu1aj1hbr41IQhsfycPPGJauDPffRWWjDw5Vd8nY1_bQxiqdEK1yR0mC1x8C-jrCph6mXouAEUaBAujTveRF-qDjsBHIQoA9Sn6CQ May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Id: None May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Domain-Name: None May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Id: 2bab42aa679b4182887da08409099827 May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestShelveInstance-338221822 May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Role: member,reader May 27 03:36:18.979247 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Roles: member,reader May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2bab42aa679b4182887da08409099827"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2bab42aa679b4182887da08409099827"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2bab42aa679b4182887da08409099827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2bab42aa679b4182887da08409099827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestShelveInstance-338221822 May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 2bab42aa679b4182887da08409099827 May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestShelveInstance-338221822 May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User: tempest-TestShelveInstance-338221822-project May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Id: c338d0e7dce9404597cd0061e408091d May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestShelveInstance-338221822-project May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: method: > May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: exception: Instance f484296f-054d-43e9-a1ec-62c6868d69e4 could not be found. May 27 03:36:18.981331 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: action_args: {'id': 'f484296f-054d-43e9-a1ec-62c6868d69e4'} May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f484296f-054d-43e9-a1ec-62c6868d69e4 could not be found. May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 03:36:18.982345 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f484296f-054d-43e9-a1ec-62c6868d69e4 could not be found. May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f484296f-054d-43e9-a1ec-62c6868d69e4 could not be found. May 27 03:36:18.983996 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi May 27 03:36:18.985552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Returning 404 to user: Instance f484296f-054d-43e9-a1ec-62c6868d69e4 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 03:36:18.985552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-69663eec-0511-4e31-b14b-3c3e2f913dc5 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4" status: 404 len: 111 microversion: 2.1 time: 0.031368 May 27 03:36:18.985552 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 579/1198] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 03:36:18 2022] GET /compute/v2.1/servers/f484296f-054d-43e9-a1ec-62c6868d69e4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:36:19.163074 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bacb11b2-c3c9-4ca7-ab7b-200a700350a8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] Calling method '.version_select at 0x7f5e6f64c430>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:19.187301 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bacb11b2-c3c9-4ca7-ab7b-200a700350a8 tempest-TestShelveInstance-338221822 tempest-TestShelveInstance-338221822-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-697497828" status: 202 len: 0 microversion: 2.1 time: 0.028515 May 27 03:36:19.187893 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 620/1199] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 03:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-697497828 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:36:56.838503 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:36:56.839528 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Fri May 27 03:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:38:17.048237 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:38:17.049405 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Fri May 27 03:38:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:38:35.969698 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:38:35.971047 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Fri May 27 03:38:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:38:45.029916 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:38:45.030930 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Fri May 27 03:38:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:39:19.899078 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:39:19.900184 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Fri May 27 03:39:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:40:15.014887 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:40:15.016040 dv-cinder-828806-4-iscsi devstack@n-api.service[117766]: Fri May 27 03:40:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:40:16.850539 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:40:16.851417 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Fri May 27 03:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:41:37.061684 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:41:37.062830 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Fri May 27 03:41:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:41:55.979926 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:41:55.980767 dv-cinder-828806-4-iscsi devstack@n-api.service[117767]: Fri May 27 03:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!